Top GitHub Contributors – Agentic Review Project
Design and analyze challenging benchmark tasks to enhance AI reasoning.
- Field
- Software & coding
- Where
- Remote
- Commitment
- contract
- Posted
- First posted March 2026, still open (checked today)
Pay data for your profession: Software engineer AI trainer jobs
What the listing asks for
- Hours
- 30 a week“Able to engage reliably for 30+ hrs per week (on weekdays).”
Read from Turing's listing text; only what it states. Full listing
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
Among platforms with 10 or more priced software & coding roles, Mercor has the highest median ($88/hr across 18 roles) and OpenTrain AI the lowest ($67/hr across 89).
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
Open software & coding roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Mercor | 20 | $88/hr | Legacy Codebase Migration Expert$200/hr |
| micro1 | 21 | $75/hr | Software Engineer (Staff), Platform Engineering$350k-600k/yr |
| Alignerr | 73 | $70/hr | DevOps / IaC Engineer$90-120/hr |
| OpenTrain AI | 148 | $67/hr | Software Engineer, AI Code Evaluation$200/hr |
| Handshake AI | 13 | up to $105/hr | Senior Software Engineer - AI Data (US)Up to $150/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 345 open software & coding roles →The full listing
As posted on Turing. See the original
About Us Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Project Overview We are seeking high-caliber researchers and technical experts. The core objective of this role is to enhance the reasoning and problem-solving capabilities of a target frontier model by designing, validating, and analyzing challenging benchmark tasks.
What the role entails:
- Task Design and Development: Design challenging, real-world problems that serve as the foundation for a model. Problems should be constructed to target specific core capability loss failures identified in a leading model.
- Content Generation: Integrate the problems into an Agentic development environment, preparing all necessary components using Python, which include:
- Detailed Instructions and an overview of the required task.
- A Golden solution that follows the instructions.
- The necessary Environment, including datasets, Python libraries, and metadata.
- A Test notebook containing unit tests that solutions must pass.
- Evaluation and Analysis: Evaluate the cross model’s performance on the tasks.
- Headroom Identification: Identify tasks where target model fails to pass all tests, specifically classifying the failure as a logical reasoning failure.
- Loss Extraction: Analyze the agent’s steps (Agent Trajectory) to observe and extract core capability loss patterns from the model.
Required Skills
- Highly-skilled GitHub contributors.
- Applicants must have strong expertise in either data science, ML, coding, or a deep quantitative background in frontier STEM.
- Able to engage reliably for 30+ hrs per week (on weekdays).
Evaluation Process
- The application process takes ~15 minutes.
- Completion of an AI video interview is required.
From applying to your first payment on Turing
- 1
Apply to this listing
Apply on work.turing.com with Apply Now and finish any assessments the listing asks for. Turing says reviews take 48 hours to 6 weeks.
- 2
Shortlist and client decision
Shortlisted isn't an offer: the client makes the final choice, and Turing asks you to confirm your rate, availability and terms before onboarding.
- 3
Onboarding
Verify your ID, complete tax forms and add a bank account in your own name, through Turing or Deel.
- 4
First payment
Hours are paid monthly, by the 5th business day of the following month, once your manager approves them.
Sources: Turing help: Apply for jobs at Turing, Turing help: How long does the application review take?, Turing help: What happens after being shortlisted?, Turing help: Project onboarding, Turing help: Project offboarding
Full Turing profile: watch-outs and the public record →Pay history
What workers report about Turing
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other software & coding roles
- Software Engineer (Staff), Platform Engineeringmicro1$350k-600k/yr
- Strategic Project Lead, AI Coding & Evaluationsmicro1$300k-500k/yr
- Legacy Codebase Migration ExpertMercor$200/hr
- Open Source GitHub MaintainerOpenTrain$120-200/hr
- Software Engineer – ($200/hr)Turing$200/hr
- Software Engineer, AI Code EvaluationOpenTrain$200/hr