Software Engineer, AI Code Evaluation
Create and refine programming examples used to train and assess AI models. You will write and correct code, review AI-generated solutions, and build Python tools that check code quality and identify recurring errors.
- Field
- Software & coding
- Where
- United States
- Commitment
- part time
- Hours
- up to 20/week
- Posted
- 5 days ago
Pay data for your profession: Software engineer AI trainer jobs
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
At $200/hr, this role pays more than 100% of the 220 open software & coding roles with a listed pay range, above the median of $70.
Among platforms with 10 or more priced software & coding roles, Mercor has the highest median ($88/hr across 18 roles) and OpenTrain AI the lowest ($65/hr across 107).
OpenTrain AI roles that closed since late October stayed listed a median of 31 days (122 roles). OpenTrain AI posted this one 5 days ago.
Computed from 2,746 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Appen and OpenTrain AI, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
What you would earn at this rate
Rate
$200/hr
Per week, before tax
$4,000
Per month, if the work is steady
$17,333
- Tax
- Contract pay arrives with no tax withheld. A US contractor at this rate and these hours would set aside about $4,308 a month for self-employment tax plus federal income tax at the 12% bracket (25%, before state tax). Outside the US, your own country's rules apply.
Assumes paid hours only; unpaid assessments, onboarding and gaps between projects lower the real figure. Full take-home calculator · Track what you actually earn
Open software & coding roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Mercor | 20 | $88/hr | Legacy Codebase Migration Expert$200/hr |
| micro1 | 25 | $75/hr | Strategic Project Lead, Coding/SWE$300k-500k/yr |
| Alignerr | 73 | $70/hr | DevOps / IaC Engineer$90-120/hr |
| OpenTrain AIthis role | 123 | $65/hr | Open Source GitHub Maintainer Code Review$120-200/hr |
| Handshake AI | 10 | up to $90/hr | Senior Software Engineer - AI Data (US)Up to $150/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 251 open software & coding roles →The full listing
As posted on OpenTrain AI. See the original
The work
Create and refine programming examples used to train and assess AI models. You will write and correct code, review AI-generated solutions, and build Python tools that check code quality and identify recurring errors.
- Evaluate code across software design, APIs, production implementation, testing, monitoring, and maintenance.
- Assess solutions for efficiency, scalability, reliability, and performance.
- Work mainly with Python, with evaluation tasks also covering JavaScript, Java, C, C++, Rust, and Go.
- Work with other teams to improve AI coding systems.
What it pays and takes
- Pay: $200 per hour.
- Time commitment: 20 or more hours per week.
- Location: Remote; open to candidates in the United States.
- Engagement: Contractor role with an initial one-month project and potential extensions.
- You should have strong production-grade Python skills, experience building full-stack applications and deploying scalable software, and a strong grasp of software design, development, debugging, and code review.
- Working knowledge of JavaScript, Java, C, C++, Rust, or Go is relevant to the evaluation work.
- You need strong written and spoken communication skills to explain your evaluations clearly.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training work is the human work behind AI systems: people prepare examples and review model outputs so systems can learn from them. Experienced software engineers are needed to create reliable code examples and judge whether AI-generated solutions work well.
From applying to your first payment on OpenTrain AI
- 1
Create a profile
Create a free OpenTrain profile with your domains, languages and hourly rate.
- 2
Apply
Apply to the listing. Some listings hire through OpenTrain; others send you to the hiring platform.
- 3
Funded milestones
The client funds each milestone before work starts.
- 4
First payment
OpenTrain pays out to your connected payout method when the client approves the milestone. It doesn't publish a fixed payout schedule.
Sources: OpenTrain: AI training careers, OpenTrain docs: invoicing and payouts
Full OpenTrain AI profile: watch-outs and the public record →Pay history
OpenTrain AI has listed this role at $200/hr since Nov 6, 2026 with no change.
Across OpenTrain AI's software & coding roles, the median listed pay was $65/hr on Nov 1, 2026 (72 roles) and is $65/hr as of Nov 11, 2026 (107 roles).
What workers report about OpenTrain AI
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other software & coding roles
- Strategic Project Lead, Coding/SWEmicro1$300k-500k/yr
- Legacy Codebase Migration ExpertMercor$200/hr
- Open Source GitHub Maintainer Code ReviewOpenTrain$120-200/hr
- Software Engineer (Electron.js)micro1$200k-320k/yr
- DevOps / Platform Engineer Talent NetworkMercor$70-150/hr
- Full-Stack Engineer Talent NetworkMercor$70-150/hr