Open-Source Code Reviewer (Python)

The work

You will review public Python repositories and software issues to support AI evaluation. The work focuses on assessing code quality and how well language models handle realistic bug-fixing tasks.

You will work with real codebases locally and help identify repositories and issues that create useful engineering challenges for AI models.

• Analyze and triage GitHub issues across open-source Python libraries.
• Set up repositories and Docker-based development environments.
• Review unit-test coverage and software quality.
• Run and modify code locally to evaluate bug-fixing performance.
• Work with researchers to identify meaningful coding tasks for language models.

What it pays and takes

• Pay: $25 per approved task.
• Schedule: 20 or more hours per week.
• Assignment length: Expected to last four weeks.
• Location: Remote contractor assignment open to candidates in Latin America.
• Time overlap: Four hours of overlap with Pacific Time.
• Language: Professional fluency in English.
• Experience: At least two years of software engineering experience.
• Skills: Strong Python, Git, Docker, and basic software pipeline setup skills.
• You should be comfortable navigating complex codebases and running, modifying, and testing projects locally.
• Experience contributing to or evaluating open-source projects is helpful. Experience with language model research, developer tools, or automation agents is also helpful.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work is the human work behind systems that learn from examples, including code review, response evaluation, and software testing. People with strong technical skills help assess whether AI-generated work is accurate, useful, and safe, which is why specialist projects seek software engineering experience.