Skip to content
AI Training Pay
esc
  • Loading roles…

  • Pages and tools

OpenTrain

SWE Bench Engineer (Java LLM Code Evaluation)

You will assess Java software projects and help measure how well language models handle real bug-fixing tasks. The work involves running, changing, testing, and reviewing open-source code locally.

Field
Machine learning
Where
Argentina, Belize, Bolivia, Brazil, Chile, Colombia +17 more
Commitment
part time
Hours
up to 20/week
Posted
today

Pay data for your profession: Data scientist AI trainer jobs

How this pay compares

The title points to rating and reviewing ai output: judging a model's answers or code against guidelines, such as which of two is better or whether one is correct and safe. What each kind of AI training work pays

Among platforms with 10 or more priced machine learning roles, Mercor has the highest median ($108/hr across 10 roles) and Alignerr the lowest ($63/hr across 13).

OpenTrain AI roles that closed since late October stayed listed a median of 31 days (122 roles). OpenTrain AI posted this one today.

Computed from 2,746 open roles we track across Mercor, micro1, Handshake AI, Alignerr, Appen and OpenTrain AI, refreshed daily. Midpoints of listed ranges; “up to” ceilings are left out of medians.

Open machine learning roles on each platform

The same kind of work, priced on every platform we track, with the best-paid open role on each.

PlatformOpenMedianBest-paid open role
Mercor10$108/hrMachine Learning Engineer Talent Network$70-250/hr
micro112$90/hrApplied Scientist$245-280/hr
OpenTrain AIthis role41$90/hrBioinformatics Machine Learning Expert$175/hr
Alignerr13$63/hrSoftware Engineer - Machine Learning$90-120/hr
Handshake AI3up to $75/hr3 pricedData ScientistUp to $120/hr

“Up to” rows list only ceilings, so their median is a maximum, not comparable with the range midpoints above them.

All 79 open machine learning roles →

The full listing

As posted on OpenTrain AI. See the original

The work

You will assess Java software projects and help measure how well language models handle real bug-fixing tasks. The work involves running, changing, testing, and reviewing open-source code locally.

  • Analyze and triage issues in open-source Java libraries.
  • Set up repositories, Docker-based development environments, and basic software pipelines.
  • Review unit-test coverage and overall code quality.
  • Modify and run projects locally to evaluate LLM performance on bug-fixing tasks.
  • Find repositories and issues that create meaningful evaluation challenges for language models.
  • Work with researchers and, when needed, guide junior engineers on related projects.

What it pays and takes

This is a remote contractor assignment for freelancers in Latin America. It is a one-month contract, and the structured time commitment is 20 or more hours per week.

  • Pay: $25 per approved task.
  • Location: Open to candidates in Latin America.
  • Schedule: 20 or more hours per week, including four hours of overlap with PST.
  • Experience: At least three years of overall software engineering experience.
  • Technical skills: Strong hands-on Java experience, plus proficiency with Git, Docker, and basic software pipeline setup.
  • You must be comfortable navigating complex codebases and running, modifying, and testing real-world projects locally.
  • Helpful experience includes contributing to or evaluating open-source projects, participating in LLM research or evaluation, and building or testing developer tools or automation agents.
  • Language: Professional fluency in English.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses human review to help improve artificial intelligence systems. In this role, software engineers evaluate model-generated code and realistic bug-fixing attempts, so strong engineering experience helps produce reliable feedback.

From applying to your first payment on OpenTrain AI

  1. 1

    Create a profile

    Create a free OpenTrain profile with your domains, languages and hourly rate.

  2. 2

    Apply

    Apply to the listing. Some listings hire through OpenTrain; others send you to the hiring platform.

  3. 3

    Funded milestones

    The client funds each milestone before work starts.

  4. 4

    First payment

    OpenTrain pays out to your connected payout method when the client approves the milestone. It doesn't publish a fixed payout schedule.

Sources: OpenTrain: AI training careers, OpenTrain docs: invoicing and payouts

Full OpenTrain AI profile: watch-outs and the public record →

Pay history

OpenTrain AI has listed this role at $25 per task since Nov 11, 2026 with no change.

Across OpenTrain AI's machine learning roles, the median listed pay was $90/hr on Nov 1, 2026 (25 roles) and is $90/hr as of Nov 11, 2026 (37 roles).

What workers report about OpenTrain AI

Anonymous reports from people who applied or worked there: whether they got work, what they were paid and how fast.

Other machine learning roles

All 79 machine learning roles →