Member of Technical Staff, Frontier AI Evaluation Lead
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
- Field
- Machine learning
- Where
- United States, Algeria, Argentina, Austria, Bahrain, Bangladesh +46 more
- Hours
- up to 20/week
- Posted
- 2 days ago
Pay data for your profession: Data scientist AI trainer jobs
What the listing asks for
- Hours
- 20 a week“Time: 20+ hours per week.”
Read from OpenTrain AI's listing text; only what it states. Full listing
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
At $142/hr (the midpoint of $115 to $168), this role pays more than 91% of the 68 open machine learning roles with a listed pay range, above the median of $90.
Among platforms with 10 or more priced machine learning roles, OpenTrain AI has the highest median ($109/hr across 34 roles) and Alignerr the lowest ($63/hr across 13).
OpenTrain AI roles that closed since late October stayed listed a median of 26 days (289 roles). OpenTrain AI posted this one 2 days ago.
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
What you would earn at this rate
Per week, before tax
$2,837
Per month, if the work is steady
$12,292
- Tax
- Contract pay arrives with no tax withheld. A US contractor at this rate and these hours would set aside about $3,108 a month for self-employment tax plus federal income tax at the 12% bracket (25%, before state tax). Outside the US, your own country's rules apply.
Assumes paid hours only; unpaid assessments, onboarding and gaps between projects lower the real figure. Full take-home calculator · Track what you actually earn
Open machine learning roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| OpenTrain AIthis role | 47 | $109/hr | Bioinformatics Machine Learning Expert$175/hr |
| Mercor | 10 | $108/hr | Machine Learning Engineer Talent Network$70-250/hr |
| micro1 | 15 | $90/hr | Member of Technical Staff, Cortex Lab (applied AI research)$300k-700k/yr |
| Alignerr | 13 | $63/hr | Software Engineer - Machine Learning$90-120/hr |
| Handshake AI | 3 | up to $75/hr3 priced | Data ScientistUp to $120/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 128 open machine learning roles →The full listing
As posted on OpenTrain AI. See the original
The work
- Own research and evaluation initiatives from problem framing through data design, quality calibration, and signal validation.
- Design ML-oriented data systems with task definitions, annotation schemas, rubrics, incentives, and pipelines tied to model performance.
- Analyze model and system failures to find root causes, edge cases, and opportunities to improve performance.
- Turn unclear system behavior into evaluation frameworks and new data categories.
- Work with researchers and domain experts to calibrate quality and strengthen evaluation signals.
- Iterate on evaluations, datasets, and feedback loops to improve model or agent performance.
- Make evidence-based quality decisions when data integrity or signal strength is not sufficient.
- Find gaps in evaluation coverage and recommend where to invest, iterate, or stop.
- Collaborate with researchers, domain experts, operators, and cross-functional teams to improve evaluation quality and deployed AI systems.
What it pays and takes
- Pay: $115.38 to $168.27 per hour.
- Time: 20+ hours per week.
- Location: Remote contractor role open to candidates in approved countries across the Americas, Europe, Africa, Asia, and the Middle East.
- Language: Professional fluency in English.
- Requirements: Experience designing ML-oriented datasets, evaluation frameworks, and quality assurance processes; strong judgment about research signal quality and evidence readiness; the ability to structure messy real-world system behavior into research and evaluation opportunities, explain tradeoffs and limitations clearly, work directly with experts during calibration and iteration, and take a systems-level view of end-to-end model or agent performance.
- Helpful background includes reinforcement learning environments, simulators, feedback-driven training systems, agentic systems, applied research, production systems, complex-task evaluation, or expert incentive design.
How it works
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 4 screening questions.
About AI training work
AI training is the human work behind modern AI systems, including evaluating model behavior, designing datasets, and reviewing feedback signals. People with strong technical judgment help turn real-world system behavior into reliable training data and evaluation results.
From applying to your first payment on OpenTrain AI
- 1
Create a profile
Create a free OpenTrain profile with your domains, languages and hourly rate.
- 2
Apply
Apply to the listing. Some listings hire through OpenTrain; others send you to the hiring platform.
- 3
Funded milestones
The client funds each milestone before work starts.
- 4
First payment
OpenTrain pays out to your connected payout method when the client approves the milestone. It doesn't publish a fixed payout schedule.
Sources: OpenTrain: AI training careers, OpenTrain docs: invoicing and payouts
Full OpenTrain AI profile: watch-outs and the public record →Pay history
OpenTrain AI has listed this role at $115-168.27/hr since Nov 21, 2026 with no change.
Across OpenTrain AI's machine learning roles, the median listed pay was $90/hr on Nov 1, 2026 (23 roles) and is $109/hr as of Nov 22, 2026 (34 roles).
What workers report about OpenTrain AI
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other machine learning roles
- Member of Technical Staff, Cortex Lab (applied AI research)micro1$300k-700k/yr
- Machine Learning Engineer Talent NetworkMercor$70-250/hr
- Member of Technical Staff, Infrastructuremicro1$320k-500k/yr
- AI/ML Engineer, LLM ApplicationsOpenTrain$70-200/hr
- Bioinformatics Machine Learning ExpertOpenTrain$175/hr
- ML Research Engineer, Inference and GPU KernelsOpenTrain$100-170/hr