Senior Software Engineer - AI Evaluation / Coding Agents ($100-150/hr)
Evaluate and improve AI coding models by reviewing generated code.
- Field
- Software & coding
- Where
- North America
- Commitment
- hourly
- Posted
- First posted September 2026, still open (checked today)
Pay data for your profession: Software engineer AI trainer jobs
What the listing asks for
- Experience
- 5+ years“5+ years of hands-on software engineering experience”
- Hours
- 20-40 a week“Availability: 20-40 hours/week, with at least 6 hours of Pacific Time overlap/day”
Read from Turing's listing text; only what it states. Full listing
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
At $125/hr (the midpoint of $100 to $150), this role pays more than 94% of the 200 open software & coding roles with a listed pay range, above the median of $70.
Among platforms with 10 or more priced software & coding roles, Mercor has the highest median ($88/hr across 18 roles) and OpenTrain AI the lowest ($67/hr across 89).
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
What you would earn at this rate
Per week, before tax
$1,875
Per month, if the work is steady
$8,125
- Tax
- Contract pay arrives with no tax withheld. A US contractor at this rate and these hours would set aside about $2,054 a month for self-employment tax plus federal income tax at the 12% bracket (25%, before state tax). Outside the US, your own country's rules apply.
Assumes paid hours only; unpaid assessments, onboarding and gaps between projects lower the real figure. Full take-home calculator · Track what you actually earn
Open software & coding roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Mercor | 20 | $88/hr | Legacy Codebase Migration Expert$200/hr |
| micro1 | 21 | $75/hr | Software Engineer (Staff), Platform Engineering$350k-600k/yr |
| Alignerr | 73 | $70/hr | DevOps / IaC Engineer$90-120/hr |
| OpenTrain AI | 148 | $67/hr | Software Engineer, AI Code Evaluation$200/hr |
| Handshake AI | 13 | up to $105/hr | Senior Software Engineer - AI Data (US)Up to $150/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 345 open software & coding roles →The full listing
As posted on Turing. See the original
Freelance · Remote · North America (only)
About Turing
Turing is one of the world’s leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.
Engagement Details
- Compensation: $100-$150/hour, please provide a specific hourly rate expectation
- Availability: 20-40 hours/week, with at least 6 hours of Pacific Time overlap/day
- Type: Independent contractor
- Duration: Approximately 3 months
- Start: As soon as possible
- Location: North America (Only)
About the Role
We’re looking for experienced, hands-on software engineers to help evaluate and improve AI coding models. Rather than primarily building production applications, you’ll work with coding agents across real-world repositories and assess the quality of their work. You’ll review generated code and agent behavior, determine whether solutions are technically correct, identify failure modes, and create the evaluation signals and feedback used to improve model performance. Think of the coding agent as another engineer whose work you’re reviewing: Can it understand the task? Did it choose the right approach? Is the resulting code correct, robust, and maintainable? Can you explain precisely where it succeeded or failed?
What You’ll Do
- Design, refine, and iterate on rubrics and evaluation criteria for preference data
- Review and label data with a high quality bar, catching subtle issues others might overlook
- Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation workflows
- Synthesize findings from data work into clear write-ups, updates, and recommendations for the team
- Collaborate closely with researchers and engineers to translate qualitative judgment into scalable processes
What We’re Looking For
- 5+ years of hands-on software engineering experience
- Strong proficiency in Python, TypeScript/JavaScript, Go, or another major production language
- Experience working in substantial real-world codebases
- Strong code-review skills and technical judgment
- Ability to clearly explain why an implementation is correct, incorrect, or could be improved
- Strong written communication
- Experience using modern LLMs or AI coding tools
Experience with LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training is a plus, but not required.
Evaluation Process
- AI interview (~25 minutes)
- Practical code/AI evaluation exercise (~30 minutes)
- Hiring manager interview (~20 minutes)
The practical exercise focuses on your ability to review and evaluate AI-generated code, not competitive programming or algorithm puzzles.
From applying to your first payment on Turing
- 1
Apply to this listing
Apply on work.turing.com with Apply Now and finish any assessments the listing asks for. Turing says reviews take 48 hours to 6 weeks.
- 2
Shortlist and client decision
Shortlisted isn't an offer: the client makes the final choice, and Turing asks you to confirm your rate, availability and terms before onboarding.
- 3
Onboarding
Verify your ID, complete tax forms and add a bank account in your own name, through Turing or Deel.
- 4
First payment
Hours are paid monthly, by the 5th business day of the following month, once your manager approves them.
Sources: Turing help: Apply for jobs at Turing, Turing help: How long does the application review take?, Turing help: What happens after being shortlisted?, Turing help: Project onboarding, Turing help: Project offboarding
Full Turing profile: watch-outs and the public record →Pay history
Turing has listed this role at $100-150/hr since Nov 22, 2026 with no change.
What workers report about Turing
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other software & coding roles
- Software Engineer (Staff), Platform Engineeringmicro1$350k-600k/yr
- Strategic Project Lead, AI Coding & Evaluationsmicro1$300k-500k/yr
- Legacy Codebase Migration ExpertMercor$200/hr
- Open Source GitHub MaintainerOpenTrain$120-200/hr
- Software Engineer – ($200/hr)Turing$200/hr
- Software Engineer, AI Code EvaluationOpenTrain$200/hr