Data Scientist Expert, AI Model Evaluation
Create realistic analytical problems based on practical data science work, then write complete reference answers that explain the reasoning behind each step. You will also review analytical approaches and catch subtle statistical or methodological errors.
- Field
- Machine learning
- Where
- United States, Albania, Algeria, Antigua and Barbuda, Armenia, Australia +89 more
- Asks for
- PhD
- Posted
- 4 days ago
Pay data for your profession: Data scientist AI trainer jobs · PhD AI trainer jobs
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
At $115/hr, this role pays more than 78% of the 72 open machine learning roles with a listed pay range, above the median of $90.
Open machine learning roles that ask for a PhD have a median of $90/hr (16 roles).
Among platforms with 10 or more priced machine learning roles, Mercor has the highest median ($108/hr across 10 roles) and Alignerr the lowest ($63/hr across 13).
OpenTrain AI roles that closed since late October stayed listed a median of 31 days (122 roles). OpenTrain AI posted this one 4 days ago.
Computed from 2,746 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Appen and OpenTrain AI, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
What you would earn at this rate
Rate
$115/hr
Per week, before tax
$1,725
Per month, if the work is steady
$7,475
- Tax
- Contract pay arrives with no tax withheld. A US contractor at this rate and these hours would set aside about $1,890 a month for self-employment tax plus federal income tax at the 12% bracket (25%, before state tax). Outside the US, your own country's rules apply.
Assumes paid hours only; unpaid assessments, onboarding and gaps between projects lower the real figure. Full take-home calculator · Track what you actually earn
Open machine learning roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Mercor | 10 | $108/hr | Machine Learning Engineer Talent Network$70-250/hr |
| micro1 | 12 | $90/hr | Applied Scientist$245-280/hr |
| OpenTrain AIthis role | 41 | $90/hr | Bioinformatics Machine Learning Expert$175/hr |
| Alignerr | 13 | $63/hr | Software Engineer - Machine Learning$90-120/hr |
| Handshake AI | 3 | up to $75/hr3 priced | Data ScientistUp to $120/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 79 open machine learning roles →The full listing
As posted on OpenTrain AI. See the original
The work
Create realistic analytical problems based on practical data science work, then write complete reference answers that explain the reasoning behind each step. You will also review analytical approaches and catch subtle statistical or methodological errors.
- Create and solve problems involving experiments, metrics, forecasting, segmentation, and predictive modeling.
- Assess whether analytical methods are sound and explain decisions clearly so model responses can be evaluated consistently.
What it pays and takes
- Pay: $115 per hour.
- Location: Open to candidates in the United Arab Emirates, Antigua and Barbuda, Albania, Armenia, Austria, Australia, Bosnia and Herzegovina, Belgium, Bulgaria, Bahrain, Benin, Brunei, the Bahamas, Bhutan, Botswana, Canada, Switzerland, Côte d’Ivoire, Costa Rica, Cyprus, Czechia, Germany, Denmark, Algeria, Ecuador, Estonia, Spain, Ethiopia, Finland, and France.
- Location: Also open to candidates in the United Kingdom, the Gambia, Greece, Guatemala, Guyana, Hong Kong, Croatia, Hungary, Indonesia, Ireland, Israel, India, Iceland, Italy, Jamaica, Jordan, Kenya, Kuwait, Saint Lucia, Liechtenstein, Sri Lanka, Lithuania, Luxembourg, Latvia, Morocco, Moldova, Madagascar, North Macedonia, Mongolia, Malta, and Mauritius.
- Location: Also open to candidates in Mexico, Malaysia, Mozambique, Namibia, the Netherlands, Norway, New Zealand, Oman, Panama, Peru, the Philippines, Pakistan, Poland, Portugal, Qatar, Romania, Serbia, Rwanda, Sweden, Singapore, Slovenia, Slovakia, Senegal, El Salvador, Thailand, Tunisia, Turkey, Trinidad and Tobago, Taiwan, Tanzania, the United States, Uzbekistan, Vietnam, and South Africa.
- At least three years of full-time experience working as a data scientist.
- A master’s or PhD in statistics, computer science, economics, mathematics, or another quantitative field.
- Strong SQL skills and proficiency in Python or R, plus hands-on experience with A/B testing, regression, causal inference, or predictive modeling.
- Helpful experience includes working on product, growth, or marketplace teams; designing and presenting experiments; and explaining analyses step by step. Clear written English is also helpful.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training work uses examples created and reviewed by people to help improve AI models. OpenTrain helps people find AI training and data-labeling roles and start applications, with a free account. Experienced data scientists are valued for the judgment needed to catch analytical errors and produce clear, reliable reference answers.
From applying to your first payment on OpenTrain AI
- 1
Create a profile
Create a free OpenTrain profile with your domains, languages and hourly rate.
- 2
Apply
Apply to the listing. Some listings hire through OpenTrain; others send you to the hiring platform.
- 3
Funded milestones
The client funds each milestone before work starts.
- 4
First payment
OpenTrain pays out to your connected payout method when the client approves the milestone. It doesn't publish a fixed payout schedule.
Sources: OpenTrain: AI training careers, OpenTrain docs: invoicing and payouts
Full OpenTrain AI profile: watch-outs and the public record →Pay history
OpenTrain AI has listed this role at $115/hr since Nov 10, 2026 with no change.
Across OpenTrain AI's machine learning roles, the median listed pay was $90/hr on Nov 1, 2026 (25 roles) and is $90/hr as of Nov 11, 2026 (37 roles).
What workers report about OpenTrain AI
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other machine learning roles
- Data Science Specialistmicro1$150-350/hr
- Data Science Specialistmicro1$150-350/hr
- Applied Scientistmicro1$245-280/hr
- Machine Learning Engineer Talent NetworkMercor$70-250/hr
- Junior Data Scientistmicro1$150-200/hr
- Bioinformatics Machine Learning ExpertOpenTrain$175/hr