Quality Analyst-Multimodality
Analyze and improve large language models through detailed content evaluation.
- Field
- Generalist
- Where
- Remote
- Commitment
- contract
- Posted
- 29 days ago
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
Among platforms with 10 or more priced generalist roles, Alignerr has the highest median ($80/hr across 17 roles) and micro1 the lowest ($35/hr across 39).
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
Open generalist roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Alignerr | 17 | $80/hr | Frontier Data Lead – Client Success & AI Partnerships$85-120/hr |
| Mercor | 16 | $55/hr | Stanford Youth Study — US Parents & Kids (Age 9–13)$110/hr |
| OpenTrain AI | 70 | $38/hr | Domain Expert, AI EvaluationUp to $200/hr |
| micro1 | 39 | $35/hr | Veterans Program$50-100/hr |
| Handshake AI | 8 | up to $30/hr | Domain Expert, AI Evaluation (US)Up to $200/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 170 open generalist roles →The full listing
As posted on Turing. See the original
About Turing
Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role Overview
In this role, you will be working on projects to help fine-tune large language models (like ChatGPT) using your strong analytical and English comprehension skills. The ideal candidate should have the ability to read, summarize, review and break down large content into smaller logical blocks, conduct research online, validate claims made in content through online research, and work with the LLM (Large Language Models) to solve puzzles! The projects will also help you learn how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world! Your role is critical in helping fine-tune and improve large language models (like gpt), and will make you an expert on how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world!
What does day-to-day look like: You would spend time answering a variety of interesting analytical questions and creating scenarios that can train the LLM models to get better. Here are a couple of examples which models might get wrong and you would have to give the correct answer and explanation to enable the models to learn:
- Based on a given distribution of sales by month across locations, could you analyze which location has grown the most? (Hint: what time period should we look at? should we account for sudden variability at the beginning?)
- In a small town, there are four distinct neighborhoods: Oak, Pine, Maple, and Elm. A postman is assigned to deliver mail and can only deliver to two neighborhoods in one day, with certain rules (e.g. Oak is always visited before Pine). If he delivers to Oak and Elm on the first day, which neighborhoods does the carrier deliver to on the second day?
Note: No other prior specialized domain experience is needed.
Requirements:
English Proficiency: Ability to read and write in English with a high degree of comprehension skills. Analytical Skills: Good research and analytical skills Feedback Skills: Ability to provide constructive feedback and detailed annotations. Creative Thinking: Creative and lateral thinking abilities. Communication: Excellent communication and collaboration skills. Independence: Self-motivated and able to work independently in a remote setting. Technical Setup: Desktop/Laptop set up with a good internet connection.
Preferred Qualifications:
- Bachelors degree or undergraduate in Engineering, Literature, Journalism, Communications, Arts, Statistics, or a related field.
- Proven experience of 2+ yrs in Quality Assurance, data annotation, or content review workflows Strong attention to detail, especially with text accuracy and formatting validation
- Experience writing professionally (business analysts, research analyst, copywriter, journalist, technical writer, editor, translator, etc.)
- Understanding of Excel and Google Suite.
- Proficiency in Data interpretation, Logical reasoning and Basic arithmetic is preferred.
Benefits
- Opportunity to work on cutting-edge AI projects.
- Competitive compensation.
- Flexible working hours and remote work environment.
Application Process
- Shortlisted candidates will complete an assessment.
- Once the assessment is cleared, candidates can start.
From applying to your first payment on Turing
- 1
Apply to this listing
Apply on work.turing.com with Apply Now and finish any assessments the listing asks for. Turing says reviews take 48 hours to 6 weeks.
- 2
Shortlist and client decision
Shortlisted isn't an offer: the client makes the final choice, and Turing asks you to confirm your rate, availability and terms before onboarding.
- 3
Onboarding
Verify your ID, complete tax forms and add a bank account in your own name, through Turing or Deel.
- 4
First payment
Hours are paid monthly, by the 5th business day of the following month, once your manager approves them.
Sources: Turing help: Apply for jobs at Turing, Turing help: How long does the application review take?, Turing help: What happens after being shortlisted?, Turing help: Project onboarding, Turing help: Project offboarding
Full Turing profile: watch-outs and the public record →Pay history
What workers report about Turing
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other generalist roles
- Domain Expert, AI EvaluationOpenTrainUp to $200/hr
- Domain Expert, AI Evaluation (US)Handshake AIUp to $200/hr
- PhD Researcher for AI Model Evaluation at Project IterOpenTrain$150/hr
- AI Chatbot TesterAlignerr$40-120/hr
- AI Ethics ReviewerAlignerr$40-120/hr
- AI Trainer SpecialistAlignerr$40-120/hr