Human Intelligence Collector Interview Evaluator
This role involves conducting or evaluating structured interviews used to support AI training. You will assess how reliable and consistent responses are, interpret communication cues, and explain your judgments in clear written records.
- Field
- Generalist
- Where
- United States, Algeria, Argentina, Austria, Bahrain, Bangladesh +46 more
- Commitment
- part time
- Hours
- up to 15/week
- Posted
- 1 month ago
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
At $45/hr (the midpoint of $25 to $65), this role pays more than 36% of the 206 open generalist roles with a listed pay range, below the median of $60.
Among platforms with 10 or more priced generalist roles, Alignerr has the highest median ($80/hr across 17 roles) and micro1 the lowest ($50/hr across 54).
OpenTrain AI roles that closed since late October stayed listed a median of 31 days (122 roles). OpenTrain AI posted this one 51 days ago.
Computed from 2,746 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Appen and OpenTrain AI, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
What you would earn at this rate
Per week, before tax
$675
Per month, if the work is steady
$2,925
- Tax
- Contract pay arrives with no tax withheld. A US contractor at this rate and these hours would set aside about $739 a month for self-employment tax plus federal income tax at the 12% bracket (25%, before state tax). Outside the US, your own country's rules apply.
Assumes paid hours only; unpaid assessments, onboarding and gaps between projects lower the real figure. Full take-home calculator · Track what you actually earn
Open generalist roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Alignerr | 17 | $80/hr | Frontier Data Lead – Client Success & AI Partnerships$85-120/hr |
| Mercor | 22 | $63/hr | Luxury Automotive Strategy Expert$300-350/hr |
| OpenTrain AIthis role | 115 | $61/hr | Contract Manager and Negotiator (English)$150/hr |
| micro1 | 60 | $50/hr | Member of Technical Staff, Enterprise AI$300k-700k/yr |
| Handshake AI | 24 | up to $88/hr | Intelligence Expert (Bachelor's, Master's and PhDs) - AI TrainerUp to $200/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 238 open generalist roles →The full listing
As posted on OpenTrain AI. See the original
The work
This role involves conducting or evaluating structured interviews used to support AI training. You will assess how reliable and consistent responses are, interpret communication cues, and explain your judgments in clear written records.
The title identifies this opportunity as Human Intelligence Collector, while the duties describe interview evaluation work. Review the duties and qualifications before applying.
- Conduct or assess structured elicitation and interview sessions involving varied subjects.
- Build rapport that supports open communication without pressure or coercion.
- Interpret tone, pacing, hesitation, gestures, and other verbal or nonverbal cues as conversations develop.
- Adjust questioning strategies based on the direction of an interview.
- Assess confidence, consistency, reliability, and possible evasiveness in responses.
- Identify and annotate emotional and motivational drivers.
- Score or annotate sessions against a detailed rubric while staying objective across cases.
- Document analytical reasoning clearly and in a way others can trace.
What it pays and takes
This is a remote, part-time contractor opportunity. The preferred location is the United States, and the role is open to candidates in the countries listed below.
- Pay: $25 to $65 per hour.
- Time: Approximately 15 hours per week or more.
- Location: Remote, with a preferred US-based location.
- Open to candidates in: the United Arab Emirates, Argentina, Austria, Bangladesh, Belgium, Bahrain, Brazil, Canada, Switzerland, Chile, Colombia, Germany, Denmark, Algeria, Egypt, Spain, France, the United Kingdom, Ghana, Greece, Indonesia, India, Italy, Jordan, Japan, Kenya, Kyrgyzstan, Kuwait, Kazakhstan, Lebanon, Sri Lanka, Morocco, Mexico, Malaysia, Nigeria, the Netherlands, Oman, Peru, the Philippines, Pakistan, Palestine, Portugal, Qatar, Saudi Arabia, Singapore, Thailand, Tunisia, Taiwan, Uzbekistan, Vietnam, and South Africa.
- Language: Fluent written and spoken English.
- Experience: A background of 3 to 5 or more years in professional interviewing, intelligence elicitation, investigative questioning, skilled negotiation, or a related field is preferred.
- Useful strengths: Interpreting verbal and nonverbal cues, making objective judgments, and explaining analytical decisions in writing.
- Relevant training: The PEACE model, cognitive interviewing, or a comparable interviewing framework.
- Relevant experience: Data annotation, AI model evaluation, assessment reporting, working with diverse populations, or working with interpreters.
How it works
You apply here in about two minutes and finish on the hiring platform. The next step is a short AI interview (technical roles include a coding challenge). Passing it is how you qualify for paid tasks, so take it soon after you are invited.
The hiring platform's application for this job asks for your resume, your LinkedIn profile, your phone number, your location and answers to 7 screening questions.
About AI training work
AI training is the human work behind systems that learn from examples, ratings, and carefully reviewed information. People with strong interviewing, evaluation, and subject-matter skills help create more useful training data and are often sought for work that requires careful judgment.
From applying to your first payment on OpenTrain AI
- 1
Create a profile
Create a free OpenTrain profile with your domains, languages and hourly rate.
- 2
Apply
Apply to the listing. Some listings hire through OpenTrain; others send you to the hiring platform.
- 3
Funded milestones
The client funds each milestone before work starts.
- 4
First payment
OpenTrain pays out to your connected payout method when the client approves the milestone. It doesn't publish a fixed payout schedule.
Sources: OpenTrain: AI training careers, OpenTrain docs: invoicing and payouts
Full OpenTrain AI profile: watch-outs and the public record →Pay history
OpenTrain AI has listed this role at $25-65/hr since Nov 2, 2026 with no change.
Across OpenTrain AI's generalist roles, the median listed pay was $40/hr on Nov 1, 2026 (50 roles) and is $61/hr as of Nov 11, 2026 (114 roles).
What workers report about OpenTrain AI
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other generalist roles
- Luxury Automotive Strategy ExpertMercor$300-350/hr
- Member of Technical Staff, Enterprise AImicro1$300k-700k/yr
- Open Source GitHub Maintainermicro1$150-300/hr
- Member of Technical Staff, Infrastructuremicro1$320k-500k/yr
- Strategic Project Leadmicro1$300k-500k/yr
- Intelligence Expert (Bachelor's, Master's and PhDs) - AI TrainerHandshake AIUp to $200/hr