Context Elicitation & Conversation Evaluation Specialists - Latam, Southeastern Europe, Asia, Africa
Review AI conversations to assess context and improve recommendations.
- Field
- Generalist
- Where
- Remote
- Commitment
- contract
- Asks for
- PhD, Master's
- Posted
- 1 month ago
Pay data for your profession: PhD AI trainer jobs
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
Among platforms with 10 or more priced generalist roles, Alignerr has the highest median ($80/hr across 17 roles) and micro1 the lowest ($35/hr across 39).
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
Open generalist roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Alignerr | 17 | $80/hr | Frontier Data Lead – Client Success & AI Partnerships$85-120/hr |
| Mercor | 16 | $55/hr | Stanford Youth Study — US Parents & Kids (Age 9–13)$110/hr |
| OpenTrain AI | 70 | $38/hr | Domain Expert, AI EvaluationUp to $200/hr |
| micro1 | 39 | $35/hr | Veterans Program$50-100/hr |
| Handshake AI | 8 | up to $30/hr | Domain Expert, AI Evaluation (US)Up to $200/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 170 open generalist roles →The full listing
As posted on Turing. See the original
About Turing: Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role overview : We are seeking Subject Matter Experts (SMEs) with expertise in psychology, social work, counseling, qualitative research, HCI, communication, conflict resolution, coaching, or related advisory fields to support AI conversation evaluation research. SMEs will review conversations between participants and AI models, assess whether sufficient context was gathered before recommendations were made, identify missed opportunities for clarification, and provide structured feedback to improve conversational quality.
Job Responsibilities:
- Review AI conversations involving real-world interpersonal and everyday decision-making scenarios.
- Identify missing context and recommend relevant follow-up questions.
- Evaluate whether additional information would have changed the AI's recommendations.
- Distinguish between critical ("load-bearing") and non-essential information.
- Conduct qualitative reviews and document findings using structured evaluation guidelines.
- Collaborate with research teams to ensure consistent, high-quality assessments..
Required Qualification:
- Candidates should have at least 3–5 years of direct practicerelevant qualifications and professional experience in at least one of the following areas:
Licensed Social Work
- MSW or equivalent graduate-level qualification in Social Work.
- LCSW, LICSW, LMSW, or equivalent applicable social work license/credential.
- Experience with client assessment, case review, interviewing, counseling, or related social-work practice.
Counseling, Therapy, or Psychology
- MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential; or
- PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology.
- Experience with counseling, therapy, psychological assessment, interviewing, case review, or other relevant client-facing work.
Qualitative Research, HCI, or Communication
- MA/PhD or equivalent advanced expertise in Human-Computer Interaction (HCI), Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline.
- Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities.
- Relevant backgrounds may include Qualitative Research, HCI Research, UX/User Research, Communication Research, Anthropology, Sociology, or related disciplines.
Mediation, Coaching, Student Services, Organizational Consulting, or Related Advisory Fields
- Relevant professional qualification, credential, or demonstrated subject-matter expertise.
- Significant direct experience in advisory, client-facing, coaching, mediation, student advising/services, organizational consulting, or comparable work.
- Experience gathering context, understanding individual or organizational needs, and providing informed recommendations or guidance.
Must be based in Latam, Southeastern Europe, Asia, Africa
Preferred experience:
- Experience eliciting relevant context when clients initially provide incomplete information
- Experience working across relationships, work, education, family, planning, wellbeing, and resource constraints, considering biological, psychological, social, spiritual/existential, financial, and practical factors
- Qualitative coding or structured case review
- Ability to distinguish between context that is load-bearing for the recommendation and that is merely descriptive/non-informative
- Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering
Project Details :
- Project duration - 3 weeks (short term project)
- Project type - Pay-per-task (PPT)
- AHT - 175 minutes (approx.)
- Engagement - Full time
From applying to your first payment on Turing
- 1
Apply to this listing
Apply on work.turing.com with Apply Now and finish any assessments the listing asks for. Turing says reviews take 48 hours to 6 weeks.
- 2
Shortlist and client decision
Shortlisted isn't an offer: the client makes the final choice, and Turing asks you to confirm your rate, availability and terms before onboarding.
- 3
Onboarding
Verify your ID, complete tax forms and add a bank account in your own name, through Turing or Deel.
- 4
First payment
Hours are paid monthly, by the 5th business day of the following month, once your manager approves them.
Sources: Turing help: Apply for jobs at Turing, Turing help: How long does the application review take?, Turing help: What happens after being shortlisted?, Turing help: Project onboarding, Turing help: Project offboarding
Full Turing profile: watch-outs and the public record →Pay history
What workers report about Turing
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other generalist roles
- Domain Expert, AI EvaluationOpenTrainUp to $200/hr
- Domain Expert, AI Evaluation (US)Handshake AIUp to $200/hr
- PhD Researcher for AI Model Evaluation at Project IterOpenTrain$150/hr
- AI Chatbot TesterAlignerr$40-120/hr
- AI Ethics ReviewerAlignerr$40-120/hr
- AI Trainer SpecialistAlignerr$40-120/hr