JavaScript Code Reviewer for LLM Evaluation
You will review public JavaScript repositories and help evaluate how well large language models solve software bugs. The work includes preparing real codebases, running tests, and judging model performance in structured evaluation tasks.
- Field
- Machine learning
- Where
- Bangladesh, Egypt, Ghana, India, Mexico, Nigeria +2 more
- Commitment
- part time
- Hours
- up to 20/week
- Posted
- 9 days ago
Pay data for your profession: Data scientist AI trainer jobs
How this pay compares
The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays
Among platforms with 10 or more priced machine learning roles, Mercor has the highest median ($108/hr across 10 roles) and Alignerr the lowest ($63/hr across 13).
OpenTrain AI roles that closed since late October stayed listed a median of 31 days (122 roles). OpenTrain AI posted this one 9 days ago.
Computed from 2,746 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Appen and OpenTrain AI, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.
Open machine learning roles on each platform
The same kind of work, priced on every platform we track, with the best-paid open role on each.
| Platform | Open | Median | Best-paid open role |
|---|---|---|---|
| Mercor | 10 | $108/hr | Machine Learning Engineer Talent Network$70-250/hr |
| micro1 | 12 | $90/hr | Applied Scientist$245-280/hr |
| OpenTrain AIthis role | 41 | $90/hr | Bioinformatics Machine Learning Expert$175/hr |
| Alignerr | 13 | $63/hr | Software Engineer - Machine Learning$90-120/hr |
| Handshake AI | 3 | up to $75/hr3 priced | Data ScientistUp to $120/hr |
“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.
All 79 open machine learning roles →The full listing
As posted on OpenTrain AI. See the original
The work
You will review public JavaScript repositories and help evaluate how well large language models solve software bugs. The work includes preparing real codebases, running tests, and judging model performance in structured evaluation tasks.
- Analyze and triage issues in public JavaScript libraries.
- Prepare repositories for local use, including Docker-based development environments.
- Set up basic software pipelines and run code locally.
- Review unit-test coverage and assess overall test quality.
- Modify and test code while evaluating model responses to bug-fixing challenges.
- Help identify repositories and issues that provide useful challenges for language models.
What it pays and takes
This is a remote contractor assignment lasting approximately 2 to 3 weeks. Candidates must be comfortable working with complex codebases and communicating in English.
- Pay: $25 per task.
- Schedule: 20 or more hours per week, including 4 hours of overlap with Pacific Time.
- Location: Open to candidates in India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, or Mexico.
- Experience: At least 2 years of overall software engineering experience.
- Skills: Strong JavaScript development, Git, Docker, and basic software pipeline setup.
- You should be able to run, modify, and test real-world projects locally.
- Experience with open-source projects, LLM research or evaluation, developer tools, or automation agents is useful.
How it works
Apply on OpenTrain with your resume and then complete the application on the hiring site.
About AI training work
AI training work uses examples and reviews prepared by people to help artificial intelligence systems improve. In this role, your software engineering experience helps assess whether models can understand code and solve realistic bugs.
From applying to your first payment on OpenTrain AI
- 1
Create a profile
Create a free OpenTrain profile with your domains, languages and hourly rate.
- 2
Apply
Apply to the listing. Some listings hire through OpenTrain; others send you to the hiring platform.
- 3
Funded milestones
The client funds each milestone before work starts.
- 4
First payment
OpenTrain pays out to your connected payout method when the client approves the milestone. It doesn't publish a fixed payout schedule.
Sources: OpenTrain: AI training careers, OpenTrain docs: invoicing and payouts
Full OpenTrain AI profile: watch-outs and the public record →Pay history
OpenTrain AI has changed the listed pay once since Nov 2, 2026:
- Nov 4, 2026$20 → $25 per taskraised
Across OpenTrain AI's machine learning roles, the median listed pay was $90/hr on Nov 1, 2026 (25 roles) and is $90/hr as of Nov 11, 2026 (37 roles).
What workers report about OpenTrain AI
Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.
Other machine learning roles
- Data Science Specialistmicro1$150-350/hr
- Data Science Specialistmicro1$150-350/hr
- Applied Scientistmicro1$245-280/hr
- Machine Learning Engineer Talent NetworkMercor$70-250/hr
- Junior Data Scientistmicro1$150-200/hr
- Bioinformatics Machine Learning ExpertOpenTrain$175/hr