Domain Expert, AI Evaluation
Apply on OpenTrain with your resume, then complete the application on the hiring site.
- Field
- Generalist
- Where
- United States
- Hours
- up to 5/week
- Asks for
- PhD, Master's
- Posted
- 2 days ago
Pay data for your profession: PhD AI trainer jobs
What the listing asks for
- Experience
- 2+ years“Education and experience: A master's degree with relevant experience or current or completed PhD study in a STEM discipline, plus at least 2 years of research or industry experi…”
- Hours
- 5-20 a week“Time: Approximately 5 to 20 hours per week; opportunities may vary by discipline and project availability.”
Read from OpenTrain AI's listing text; only what it states. Full listing
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
This role lists only a ceiling, up to $200/hr. Compared with the top of every listed rate among 149 other open generalist roles, that ceiling is higher than 100% of them, above the median top rate of $45. The project may pay less than its ceiling.
Among platforms with 10 or more priced generalist roles, Alignerr has the highest median ($80/hr across 17 roles) and micro1 the lowest ($35/hr across 39).
OpenTrain AI roles that closed since late October stayed listed a median of 26 days (289 roles). OpenTrain AI posted this one 2 days ago.
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
What you would earn at this rate
Per week, before tax
$1,000
Per month, if the work is steady
$4,333
- Tax
- Contract pay arrives with no tax withheld. A US contractor at this rate and these hours would set aside about $1,096 a month for self-employment tax plus federal income tax at the 12% bracket (25%, before state tax). Outside the US, your own country's rules apply.
Assumes paid hours only; unpaid assessments, onboarding and gaps between projects lower the real figure. Full take-home calculator · Track what you actually earn
Open generalist roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Alignerr | 17 | $80/hr | Frontier Data Lead – Client Success & AI Partnerships$85-120/hr |
| Mercor | 16 | $55/hr | Stanford Youth Study — US Parents & Kids (Age 9–13)$110/hr |
| OpenTrain AIthis role | 70 | $38/hr | PhD Researcher for AI Model Evaluation at Project Iter$150/hr |
| micro1 | 39 | $35/hr | Veterans Program$50-100/hr |
| Handshake AI | 8 | up to $30/hr | Domain Expert, AI Evaluation (US)Up to $200/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 170 open generalist roles →The full listing
As posted on OpenTrain AI. See the original
The work
- Write and solve challenging problems in your STEM area of expertise.
- Develop prompts based on specialized scientific or technical concepts.
- Evaluate large language model responses for correctness, reasoning quality, and understanding of key concepts.
- Research relevant topics with AI assistance and use your findings in evaluation work.
- Turn complex research knowledge into clear task instructions and evaluation criteria.
- Work remotely and asynchronously with flexible scheduling.
What it pays and takes
- Pay: Up to $200 per hour.
- Time: Approximately 5 to 20 hours per week; opportunities may vary by discipline and project availability.
- Location: Open to candidates in the United States.
- Language: Professional fluency in English.
- Education and experience: A master's degree with relevant experience or current or completed PhD study in a STEM discipline, plus at least 2 years of research or industry experience in your field.
- Knowledge: Deep expertise in at least one STEM field, including mathematics, chemistry, biology, physics, engineering, computer science, or medicine, with the ability to explain important concepts accurately.
- Skills: Strong written communication, careful attention to detail, and the ability to work independently.
- Helpful background: Postdoctoral research, scientific or technical research, creating structured evaluation criteria, or assessing complex explanations.
How it works
Apply on OpenTrain with your resume, then complete the application on the hiring site.
About AI training work
AI training is the human work behind artificial intelligence, including writing examples and reviewing model responses. People with strong subject expertise help evaluate whether AI systems reason accurately and explain complex topics well.
OpenTrain helps people find AI training and data-labeling projects, build a profile, and apply in minutes. Creating an OpenTrain account is free.
From applying to your first payment on OpenTrain AI
- 1
Create a profile
Create a free OpenTrain profile with your domains, languages and hourly rate.
- 2
Apply
Apply to the listing. Some listings hire through OpenTrain; others send you to the hiring platform.
- 3
Funded milestones
The client funds each milestone before work starts.
- 4
First payment
OpenTrain pays out to your connected payout method when the client approves the milestone. It doesn't publish a fixed payout schedule.
Sources: OpenTrain: AI training careers, OpenTrain docs: invoicing and payouts
Full OpenTrain AI profile: watch-outs and the public record →Pay history
OpenTrain AI has listed this role at up to $200/hr since Nov 21, 2026 with no change.
Across OpenTrain AI's generalist roles, the median listed pay was $35/hr on Nov 1, 2026 (29 roles) and is $38/hr as of Nov 22, 2026 (34 roles).
What workers report about OpenTrain AI
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other generalist roles
- Domain Expert, AI Evaluation (US)Handshake AIUp to $200/hr
- PhD Researcher for AI Model Evaluation at Project IterOpenTrain$150/hr
- AI Chatbot TesterAlignerr$40-120/hr
- AI Ethics ReviewerAlignerr$40-120/hr
- AI Trainer SpecialistAlignerr$40-120/hr
- AI Training SpecialistAlignerr$40-120/hr