Personal Account Generalist Raters (US)
Evaluate AI responses using personalized prompts across Google apps.
- Field
- Generalist
- Where
- United States
- Commitment
- contract
- Posted
- 25 days ago
What the listing asks for
- Hours
- 40 a week“Commitments Required: at least 4 hours per day and upto 40 hours per week with 4 hours of overlap with PST.”
Read from Turing's listing text; only what it states. Full listing
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
Among platforms with 10 or more priced generalist roles, Alignerr has the highest median ($80/hr across 17 roles) and micro1 the lowest ($35/hr across 39).
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
Open generalist roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Alignerr | 17 | $80/hr | Frontier Data Lead – Client Success & AI Partnerships$85-120/hr |
| Mercor | 16 | $55/hr | Stanford Youth Study — US Parents & Kids (Age 9–13)$110/hr |
| OpenTrain AI | 70 | $38/hr | Domain Expert, AI EvaluationUp to $200/hr |
| micro1 | 39 | $35/hr | Veterans Program$50-100/hr |
| Handshake AI | 8 | up to $30/hr | Domain Expert, AI Evaluation (US)Up to $200/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 170 open generalist roles →The full listing
As posted on Turing. See the original
About Turing: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview: We are seeking US-based generalist raters to participate in Gemini Personalization Evals. In this role, raters will perform generalist evaluation work using personalized prompts designed to retrieve context and data across connected Google apps.
Key Qualifications:
- Location: Must be currently based in the United States.
- App Connectivity: Must be willing and able to connect their Google apps (e.g., Gmail, Google Photos, Google Calendar, Google Drive, etc.) to Gemini to support data retrieval and personalized prompt evaluations.
- Role Scope: Perform generalist rating and evaluation tasks, assessing model performance, context retrieval, and response quality across connected apps.
- Account Activity: Active use of standard Google workspace/consumer apps with sufficient personal data/history to generate and evaluate retrieval prompts.
- Exceptional Analytical Thinking: Ability to evaluate nuanced AI responses and identify strengths and weaknesses in personalization quality.
- Attention to Detail: Strong ability to review AI-generated responses and identify subtle issues or inconsistencies.
- Communication: Excellent written communication skills for providing clear and structured evaluation feedback.
- Independence: Self-motivated and able to work independently in a remote environment.
- Technical Setup: Desktop or laptop with a reliable internet connection.
Description: In this role, you will be part of a team responsible for evaluating the quality of personalized AI interactions for business users. Your day-to-day responsibilities will include:
- Evaluating AI-generated responses based on your professional email history and business account activity.
- Assessing whether responses are relevant, accurate, helpful, and appropriately personalized.
- Identifying issues related to incorrect personalization, unsupported assumptions, or irrelevant recommendations.
- Comparing multiple AI responses and determining which provides the better overall user experience.
- Providing clear, detailed, and well-reasoned evaluation feedback to support model improvements.
- Following project guidelines to ensure consistent, accurate, and high-quality evaluations.
- Maintaining data privacy and adhering to all project confidentiality requirements throughout the evaluation process.
Education & Experience
- Bachelor's degree or equivalent practical experience in any field.
- Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is preferred but not required.
Offer Details:
- Commitments Required: at least 4 hours per day and upto 40 hours per week with 4 hours of overlap with PST.
- Engagement type: Contractor
- Engagement Length: upto 16 weeks
Evaluation Process -
- Shortlisted candidates will be sent a Job Interest Form.
- Final selected candidates will be contacted with the next steps, including consent and onboarding requirements.
Consent & Compliance: Must be willing to grant the necessary app integration permissions required for the project and complete all standard consent forms and non-disclosure agreements.
From applying to your first payment on Turing
- 1
Apply to this listing
Apply on work.turing.com with Apply Now and finish any assessments the listing asks for. Turing says reviews take 48 hours to 6 weeks.
- 2
Shortlist and client decision
Shortlisted isn't an offer: the client makes the final choice, and Turing asks you to confirm your rate, availability and terms before onboarding.
- 3
Onboarding
Verify your ID, complete tax forms and add a bank account in your own name, through Turing or Deel.
- 4
First payment
Hours are paid monthly, by the 5th business day of the following month, once your manager approves them.
Sources: Turing help: Apply for jobs at Turing, Turing help: How long does the application review take?, Turing help: What happens after being shortlisted?, Turing help: Project onboarding, Turing help: Project offboarding
Full Turing profile: watch-outs and the public record →Pay history
What workers report about Turing
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other generalist roles
- Domain Expert, AI EvaluationOpenTrainUp to $200/hr
- Domain Expert, AI Evaluation (US)Handshake AIUp to $200/hr
- PhD Researcher for AI Model Evaluation at Project IterOpenTrain$150/hr
- AI Chatbot TesterAlignerr$40-120/hr
- AI Ethics ReviewerAlignerr$40-120/hr
- AI Trainer SpecialistAlignerr$40-120/hr