Software Developer — Evaluate an AI Coding Assistant
Get paid to work on real software tasks with an AI coding assistant and share your feedback on how well it supports your work....
- Field
- Software & coding
- Where
- Remote
- Posted
- first seen yesterday
Pay data for your profession: Software engineer AI trainer jobs
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
At $83/hr (the midpoint of $65 to $100), this role pays more than 78% of the 220 open software & coding roles with a listed pay range, above the median of $70.
Among platforms with 10 or more priced software & coding roles, Mercor has the highest median ($88/hr across 18 roles) and OpenTrain AI the lowest ($65/hr across 107).
Computed from 2,746 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Appen and OpenTrain AI, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
What you would earn at this rate
Per week, before tax
$1,238
Per month, if the work is steady
$5,363
- Tax
- Contract pay arrives with no tax withheld. A US contractor at this rate and these hours would set aside about $1,356 a month for self-employment tax plus federal income tax at the 12% bracket (25%, before state tax). Outside the US, your own country's rules apply.
Assumes paid hours only; unpaid assessments, onboarding and gaps between projects lower the real figure. Full take-home calculator · Track what you actually earn
Open software & coding roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Mercor | 20 | $88/hr | Legacy Codebase Migration Expert$200/hr |
| micro1 | 25 | $75/hr | Strategic Project Lead, Coding/SWE$300k-500k/yr |
| Alignerrthis role | 73 | $70/hr | DevOps / IaC Engineer$90-120/hr |
| OpenTrain AI | 123 | $65/hr | Software Engineer, AI Code Evaluation$200/hr |
| Handshake AI | 10 | up to $90/hr | Senior Software Engineer - AI Data (US)Up to $150/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 251 open software & coding roles →The full listing
As posted on Alignerr. See the original
Software Developer — Evaluate an AI Coding Assistant
Alignerr · Paid contract · Fully remote · Flexible schedule
About the Role
Alignerr is looking for software developers to work with an AI coding assistant on real tasks in existing codebases. You’ll bring a task you know how to evaluate, work through it with the assistant, and share your perspective on what helped you make progress and where you had to step in.
What You’ll Do
- Choose a meaningful task in an eligible open-source project, such as fixing a recurring bug, adding a feature, or simplifying code that’s hard to maintain.
- Work through the task with the assistant. Review its changes, test the result, and follow up as you would in your usual development work.
- Give feedback in your own words. When the assistant offers different approaches, explain which one you’d prefer and why.
Who You Are
- You have hands-on experience developing and testing software in an existing codebase.
- You can define what a successful change should do and verify that it works.
- You can explain your technical judgment clearly, including when an assistant misunderstood a request or made your work easier.
- You’re comfortable working independently on tasks that take several hours.
Project Eligibility
You can work on your own open-source project or another public codebase with an eligible license. Choose code you have permission to share, and keep confidential material, credentials, and personal data out of your submissions. Your submitted work and feedback may be used to improve AI coding tools.
From applying to your first payment on Alignerr
- 1
Sign up and apply
Sign up on Alignerr and apply to the listing.
- 2
Verify
Verify your phone and ID through Persona. Some jobs add an AI interview (Zara) or a domain assessment.
- 3
Contract and onboarding
Sign the contract and onboard on the Labelbox platform.
- 4
First payment
Labelbox's help center describes a weekly cycle: approved work from Monday to Sunday is paid by the following Friday, through Stripe Connect or PayPal depending on your country.
Sources: Alignerr: how the process works, Labelbox help: Alignerr payment FAQs
Full Alignerr profile: watch-outs and the public record →Pay history
Alignerr has listed this role at $65-100/hr since Nov 10, 2026 with no change.
Across Alignerr's software & coding roles, the median listed pay was $63/hr on Nov 1, 2026 (78 roles) and is $70/hr as of Nov 11, 2026 (73 roles).
What workers report about Alignerr
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other software & coding roles
- Strategic Project Lead, Coding/SWEmicro1$300k-500k/yr
- Legacy Codebase Migration ExpertMercor$200/hr
- Open Source GitHub Maintainer Code ReviewOpenTrain$120-200/hr
- Software Engineer, AI Code EvaluationOpenTrain$200/hr
- Software Engineer (Electron.js)micro1$200k-320k/yr
- DevOps / Platform Engineer Talent NetworkMercor$70-150/hr