Machine Learning Research Evaluation Expert
Create realistic machine learning research problems based on your research expertise, then solve them and write clear reference answers. Your work helps evaluate AI models by showing the difference between sound research judgment and answers that seem plausible but are wrong.
- Field
- Machine learning
- Where
- United States, Albania, Algeria, Antigua and Barbuda, Armenia, Australia +89 more
- Commitment
- part time
- Hours
- up to 20/week
- Asks for
- PhD, Master's
- Posted
- 5 days ago
Pay data for your profession: Data scientist AI trainer jobs · PhD AI trainer jobs
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
At $115/hr, this role pays more than 78% of the 72 open machine learning roles with a listed pay range, above the median of $90.
Open machine learning roles that ask for a PhD have a median of $90/hr (16 roles).
Among platforms with 10 or more priced machine learning roles, Mercor has the highest median ($108/hr across 10 roles) and Alignerr the lowest ($63/hr across 13).
OpenTrain AI roles that closed since late October stayed listed a median of 31 days (122 roles). OpenTrain AI posted this one 5 days ago.
Computed from 2,746 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Appen and OpenTrain AI, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
What you would earn at this rate
Rate
$115/hr
Per week, before tax
$2,300
Per month, if the work is steady
$9,967
- Tax
- Contract pay arrives with no tax withheld. A US contractor at this rate and these hours would set aside about $2,520 a month for self-employment tax plus federal income tax at the 12% bracket (25%, before state tax). Outside the US, your own country's rules apply.
Assumes paid hours only; unpaid assessments, onboarding and gaps between projects lower the real figure. Full take-home calculator · Track what you actually earn
Open machine learning roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Mercor | 10 | $108/hr | Machine Learning Engineer Talent Network$70-250/hr |
| micro1 | 12 | $90/hr | Applied Scientist$245-280/hr |
| OpenTrain AIthis role | 41 | $90/hr | Bioinformatics Machine Learning Expert$175/hr |
| Alignerr | 13 | $63/hr | Software Engineer - Machine Learning$90-120/hr |
| Handshake AI | 3 | up to $75/hr3 priced | Data ScientistUp to $120/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 79 open machine learning roles →The full listing
As posted on OpenTrain AI. See the original
The work
Create realistic machine learning research problems based on your research expertise, then solve them and write clear reference answers. Your work helps evaluate AI models by showing the difference between sound research judgment and answers that seem plausible but are wrong.
- Design problems about experiment design, ablations, model evaluation, and failure analysis.
- Explain the reasoning behind each step of your reference answers.
- Spot methodological mistakes and weak research conclusions that may take practical experience to recognize.
- Focus on evaluation work in your research specialty rather than completing a high volume of tasks.
What it pays and takes
- Pay: $115 per hour, paid weekly via Stripe.
- Schedule: At least 20 hours per week. The role is asynchronous with no fixed hours.
- Work arrangement: Remote contractor role, open to candidates based in eligible countries.
- Language: Clear written English and the ability to explain technical results step by step.
- Education: A master's or PhD in computer science, statistics, mathematics, or a related field.
- Experience: At least three years of full-time machine learning research after completing your degree. Postdoctoral research counts; doctoral study years do not.
- Skills: Hands-on experience designing experiments, running ablations, or evaluating machine learning models; strong Python skills; and experience with a deep learning framework such as PyTorch or JAX.
- Helpful experience: Publications at venues such as NeurIPS, ICML, ICLR, ACL, or CVPR, or work in an industry research lab or university research group.
How it works
Start your application on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training work is the human work behind building and evaluating AI systems, including writing and reviewing examples that help measure model performance. Research expertise matters for this project because the evaluation problems need to distinguish sound methods from convincing mistakes.
From applying to your first payment on OpenTrain AI
- 1
Create a profile
Create a free OpenTrain profile with your domains, languages and hourly rate.
- 2
Apply
Apply to the listing. Some listings hire through OpenTrain; others send you to the hiring platform.
- 3
Funded milestones
The client funds each milestone before work starts.
- 4
First payment
OpenTrain pays out to your connected payout method when the client approves the milestone. It doesn't publish a fixed payout schedule.
Sources: OpenTrain: AI training careers, OpenTrain docs: invoicing and payouts
Full OpenTrain AI profile: watch-outs and the public record →Pay history
OpenTrain AI has listed this role at $115/hr since Nov 6, 2026 with no change.
Across OpenTrain AI's machine learning roles, the median listed pay was $90/hr on Nov 1, 2026 (25 roles) and is $90/hr as of Nov 11, 2026 (37 roles).
What workers report about OpenTrain AI
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other machine learning roles
- Data Science Specialistmicro1$150-350/hr
- Data Science Specialistmicro1$150-350/hr
- Applied Scientistmicro1$245-280/hr
- Machine Learning Engineer Talent NetworkMercor$70-250/hr
- Junior Data Scientistmicro1$150-200/hr
- Bioinformatics Machine Learning ExpertOpenTrain$175/hr