Python Infrastructure Engineer, LLM Training
You will build and maintain the infrastructure behind LLM training and agent evaluation. Your work will help AI researchers create tasks, run tests, and assess how well agents perform.
- Field
- Machine learning
- Where
- United States, Canada
- Commitment
- part time
- Hours
- up to 20/week
- Posted
- 15 months ago
Pay data for your profession: Data scientist AI trainer jobs
The full listing
As posted on OpenTrain AI. See the original
The work
You will build and maintain the infrastructure behind LLM training and agent evaluation. Your work will help AI researchers create tasks, run tests, and assess how well agents perform.
The role combines Python engineering with developer tooling, automated evaluation, and secure execution environments.
- Build secure sandboxes for running agent tasks.
- Create reusable task frameworks and scoring pipelines.
- Develop automated evaluation pipelines for coding and agent tasks.
- Build reusable repositories and modern developer environments.
- Use Python back ends with FastAPI or Flask where needed.
- Guide AI researchers in using the tools you build.
What it pays and takes
This is a part-time contractor role for engineers who can take ownership of infrastructure work. Compensation is tiered by experience.
Clear English communication and a collaborative working style are required. Previous work on coding-task platforms is a strong bonus.
- Pay: Junior $34 per hour, Middle $37 per hour, or Senior $42 per hour in USD.
- Time: 20 or more hours per week.
- Location: Fully remote for people located in the United States or Canada.
- Language: Clear English communication.
- Experience: 5 or more years of hands-on Python experience.
- Required skills: Deep Linux and Docker experience.
- Required skills: Designing CI/CD pipelines, preferably with GitHub Actions.
- Required skills: FastAPI or Flask back ends, pytest-based testing, devcontainers, and Makefiles.
- Experience level: Intermediate, with a senior-minded approach to ownership and technical guidance.
- Selection requirement: Short-listed candidates complete a timed HackerRank assessment and a platform coding test before recruiter interviews.
How it works
Apply on OpenTrain. The employer reviews applications there.
About AI training work
AI training is the human work used to improve AI systems, including writing coding tasks, testing model behavior, and reviewing agent results. Engineers with strong software skills are needed to build the tools and evaluation systems that make this work reliable.
How OpenTrain AI pays and hires
OpenTrain says it is free for freelancers, with no fees or subscriptions. Clients fund each milestone before work starts, and OpenTrain pays out to your connected payout method when the client approves the milestone. It doesn't publish a fixed payout schedule.
Create a free profile with your domains, languages and hourly rate, then apply to listings. Some listings hire through OpenTrain; others link you straight to the hiring platform.
Source: OpenTrain: AI training careers, OpenTrain docs: invoicing and payouts
Full OpenTrain AI profile: watch-outs and worker reports →Other machine learning roles
- Machine Learning Evaluation SpecialistAlignerr$200-400/hr
- Principal Research Scientist in AI EvaluationOpenTrain$100-400/hr
- Data Science Presentation Review SpecialistOpenTrain$150-350/hr
- Applied Scientist AI Model EvaluationOpenTrain$245-280/hr
- Data ScientistOpenTrain$245-280/hr
- Machine Learning Engineer Talent NetworkMercor$70-250/hr