Domain Expert, AI Evaluation (US)
Handshake is recruiting Master's and PhD holders residing in the United States to partner with leading AI labs and join our AI research community. This program brings subject-matter experts together to enhance the capabilities of Large Language Models (LLMs) across specialized…
- Field
- Generalist
- Where
- United States
- Commitment
- part time
- Asks for
- PhD, Master's
- Posted
- 2 days ago
Pay data for your profession: PhD AI trainer jobs
What the listing asks for
- Experience
- 2+ years“Experience: 2+ years of research or industry experience in your field, in addition to your degree”
- Hours
- 5-20 a week“Flexible hours and the ability to work remotely, with a commitment of approximately 5 to 20 hours per week.”
- Schedule
- Asynchronous“The position is remote and asynchronous - work independently from wherever you are.”
Read from Handshake AI's listing text; only what it states. Full listing
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
This role lists only a ceiling, up to $200/hr. Compared with the top of every listed rate among 149 other open generalist roles, that ceiling is higher than 100% of them, above the median top rate of $45. The project may pay less than its ceiling.
Among platforms with 10 or more priced generalist roles, Alignerr has the highest median ($80/hr across 17 roles) and micro1 the lowest ($35/hr across 39).
Handshake AI roles that closed since late October stayed listed a median of 307 days (33 roles). Handshake AI posted this one 2 days ago.
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
What you would earn at this rate
Per week, before tax
$3,000
Per month, if the work is steady
$13,000
- Tax
- Contract pay arrives with no tax withheld. A US contractor at this rate and these hours would set aside about $3,287 a month for self-employment tax plus federal income tax at the 12% bracket (25%, before state tax). Outside the US, your own country's rules apply.
Assumes paid hours only; unpaid assessments, onboarding and gaps between projects lower the real figure. Full take-home calculator · Track what you actually earn
Open generalist roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Alignerr | 17 | $80/hr | Frontier Data Lead – Client Success & AI Partnerships$85-120/hr |
| Mercor | 16 | $55/hr | Stanford Youth Study — US Parents & Kids (Age 9–13)$110/hr |
| OpenTrain AI | 70 | $38/hr | Domain Expert, AI EvaluationUp to $200/hr |
| micro1 | 39 | $35/hr | Veterans Program$50-100/hr |
| Handshake AIthis role | 8 | up to $30/hr | Data ExpertUp to $105/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 170 open generalist roles →The full listing
As posted on Handshake AI. See the original
Overview
Handshake is recruiting Master's and PhD holders residing in the United States to partner with leading AI labs and join our AI research community. This program brings subject-matter experts together to enhance the capabilities of Large Language Models (LLMs) across specialized scientific and technical domains. The Handshake AI Fellowship program runs year-round, though project availability will vary by discipline.
Details
- The position is remote and asynchronous - work independently from wherever you are.
- Flexible hours and the ability to work remotely, with a commitment of approximately 5 to 20 hours per week.
- Project work includes, but is not limited to, writing and solving challenging problems in your area of expertise, developing domain-specific prompts and evaluating LLM responses for correctness and quality of reasoning.
- Dedicate time researching topics that are interesting to you, with the assistance of AI.
- Learn new skills while contributing to the changing world of AI across various disciplines.
- Placement into a project will be dependent on project availability. You'll apply once and, if qualified, be considered for projects as they open.
Qualifications
- Education: PhD students and graduates (including those currently enrolled in a PhD program or in postdoctoral positions), or Master’s degree holders with relevant experience, in Mathematics, Chemistry, Biology, Physics, Engineering, Computer Science, Medicine, etc.
- Experience: 2+ years of research or industry experience in your field, in addition to your degree
- Subject expertise: Deep subject knowledge and careful attention to detail, and confidence that your domain expertise can outmatch current AI systems in understanding and explaining key concepts in your field
- Written communication: Strong written communication, with the ability to translate complex research knowledge into clear, structured task instructions and evaluation criteria
Required for all applicants
- Must be based in the United States and have US work authorization
- Ability to work independently in a remote, asynchronous environment
- Availability of approximately 5 to 20 hours per week
From applying to your first payment on Handshake AI
- 1
Apply and verify
Apply and verify your identity on the Handshake AI site.
- 2
Matching
Handshake matches people to projects by background and invites you by email when one fits. Some projects require an assessment first.
- 3
Onboarding
Onboarding is paid only when a project's terms say so.
- 4
First payment
The pay week runs Monday to Sunday (Pacific). Payouts go out through Stripe by Wednesday afternoon and usually become withdrawable about two days later.
Sources: Handshake AI help: Getting started, Handshake AI help: Fellowship expectations, Handshake AI payments processing, Earning on Handshake AI
Full Handshake AI profile: watch-outs and the public record →Pay history
Handshake AI has listed this role at up to $200/hr since Nov 21, 2026 with no change.
What workers report about Handshake AI
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other generalist roles
- Domain Expert, AI EvaluationOpenTrainUp to $200/hr
- PhD Researcher for AI Model Evaluation at Project IterOpenTrain$150/hr
- AI Chatbot TesterAlignerr$40-120/hr
- AI Ethics ReviewerAlignerr$40-120/hr
- AI Trainer SpecialistAlignerr$40-120/hr
- AI Training SpecialistAlignerr$40-120/hr