Engineering Expert
Create complex engineering design tasks to evaluate AI agent performance.
- Field
- Engineering
- Where
- Remote
- Commitment
- contract
- Posted
- 10 days ago
Pay data for your profession: Engineering AI trainer jobs
What the listing asks for
- Experience
- 5+ years“Education & Expertise: Relevant degree in Electrical, Mechanical, Aerospace, with 5+ years of hands-on engineering design experience.”
- Hours
- 40 a week“Commitments Required: Upto 40 hours per week with 4 hours of overlap with PST.”
Read from Turing's listing text; only what it states. Full listing
How this pay compares
Among platforms with 10 or more priced engineering roles, micro1 has the highest median ($88/hr across 28 roles) and Alignerr the lowest ($61/hr across 14).
The same title is open on other platforms: Mercor at $60-125/hr, Handshake AI at up to $75/hr, Handshake AI at up to $75/hr and Handshake AI at up to $55/hr. Requirements and terms can differ, so compare the listings.
Computed from 3,087 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Outlier, Turing, Appen, OpenTrain AI and OneForma, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
Open engineering roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| micro1 | 29 | $88/hr | Director of Engineering, Internal Platforms$450k-800k/yr |
| Mercor | 37 | $86/hr | Infrastructure / Site Reliability Engineer (SRE)$200/hr |
| OpenTrain AI | 123 | $86/hr | Mechanical Engineer for AI TrainingUp to $200/hr |
| Alignerr | 14 | $61/hr | Robotics Technician$40-120/hr |
| Handshake AI | 47 | up to $85/hr | Engineering LeadUp to $195/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 261 open engineering roles →The full listing
As posted on Turing. See the original
About Turing: Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L.
Role Overview We are seeking experienced AI Evaluation Engineers (Engineering Simulation & Design) to author and validate "model-breaking," simulation-based engineering design problems to train and evaluate state-of-the-art AI agents. Operating across major engineering disciplines—including Electrical, Mechanical, Control Systems, Aerospace, Systems, and Robotics—you will create complex, multi-constraint tasks where AI agents must interpret requirements, navigate trade-offs, configure open-source simulation tools, diagnose failures, and iterate toward valid solutions. You will analyze agent execution logs, expose systemic reasoning gaps, and build automated, objective graders to elevate frontier model performance.
Job Requirements:
- Education & Expertise: Relevant degree in Electrical, Mechanical, Aerospace, with 5+ years of hands-on engineering design experience.
- Simulation Tooling: Proficiency with at least one domain-relevant open-source simulation package (e.g., ngspice, PySpice, OpenFOAM, FEniCSx, CalculiX, python-control, CadQuery, build123d, OpenModelica, Cantera, Gmsh) combined with strong Python scripting skills.
- AI Evaluation & Failure Diagnostics: Hands-on experience with modern LLMs/coding agents and evaluation concepts (pass@k, failure-mode analysis, nondeterministic behavior), with the ability to audit trajectory logs and isolate core reasoning/tool-use failures.
- Domain Rigor & Precision: Uncompromising attention to physical plausibility, unit consistency, boundary conditions, convergence criteria, and technical documentation.
- Availability & Commitment: Talent must have weekend on-call availability (part-time engagement is acceptable).
- Technical Infrastructure: Personal desktop/laptop equipped with a stable, high-speed internet connection in a remote setup.
Job Responsibilities:
- Model-Breaking Problem Design: Author original, self-contained engineering design tasks with competing constraints, explicit optimization targets, validated reference solutions, and objective autograders.
- Environment & Simulation Integration: Build, run, and validate problem environments using open-source simulation tools and custom Python test benches.
- Trajectory Analysis & Failure Mode Taxonomy: Evaluate coding agent outputs and execution logs across repeated trials to identify systemic failure modes (e.g., misinterpreting simulator feedback, premature design convergence, physically impossible geometries).
- Difficulty Calibration & Benchmark Refinement: Iteratively refine problem difficulty based on empirical model performance data without introducing ambiguity or missing information.
- Cross-Functional Collaboration: Partner with AI researchers, pod leads, and domain experts to integrate high-rigor benchmarks into the model evaluation pipeline.
Domains:
- Electrical Engineering
- Mechanical Engineering
- Aerospace Engineering
Education & Experience
- Bachelor or higher degree from relevant engineering domain is a must for this position.
- Experience in AI evaluation, data annotation, content review, quality assurance, or a related analytical role is required.
Offer Details:
- Commitments Required: Upto 40 hours per week with 4 hours of overlap with PST.
- Engagement type: Contractor
- Engagement Length: upto 12 weeks
Evaluation Process -
- Candidates will be require to submit a Job Interest Form & assessment.
- Talents finalized in assessment will go through delivery interview & proceeded further accordingly.
From applying to your first payment on Turing
- 1
Apply to this listing
Apply on work.turing.com with Apply Now and finish any assessments the listing asks for. Turing says reviews take 48 hours to 6 weeks.
- 2
Shortlist and client decision
Shortlisted isn't an offer: the client makes the final choice, and Turing asks you to confirm your rate, availability and terms before onboarding.
- 3
Onboarding
Verify your ID, complete tax forms and add a bank account in your own name, through Turing or Deel.
- 4
First payment
Hours are paid monthly, by the 5th business day of the following month, once your manager approves them.
Sources: Turing help: Apply for jobs at Turing, Turing help: How long does the application review take?, Turing help: What happens after being shortlisted?, Turing help: Project onboarding, Turing help: Project offboarding
Full Turing profile: watch-outs and the public record →Pay history
What workers report about Turing
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other engineering roles
- Director of Engineering, Internal Platformsmicro1$450k-800k/yr
- Member of Technical Staff, Research Engineeringmicro1$400k-800k/yr
- Senior Forward Deployed Engineer, U.S. Governmentmicro1$300k-500k/yr
- Member of Technical Staff, Data Engineeringmicro1$280k-450k/yr
- Infrastructure / Site Reliability Engineer (SRE)Mercor$200/hr
- Mechanical Engineer for AI TrainingOpenTrainUp to $200/hr