Software Engineering AI Evaluation Specialist

The Work

You will create reproducible environments that test AI models on realistic software engineering problems. You will also develop reference solutions and contribute code, debugging methods, and technical explanations for AI training data.

• Build environments and reference solutions for coding problems.
• Analyze defects and performance bottlenecks in varied codebases.
• Implement maintainable features and improve legacy code for clarity, efficiency, and reliability.
• Document technical reasoning, solution approaches, and code decisions.
• Review and validate other contributors’ code and technical submissions for accuracy and clarity.

What It Pays and Takes

This part-time contractor role focuses on software engineering code evaluation. Previous AI experience is not required, but you need strong hands-on software engineering ability and clear technical communication.

• Pay: $50 to $100 per hour equivalent, paid per task that meets the project specifications.
• Time: Approximately 15 hours per week, with less than 20 hours per week expected.
• Location: Open to candidates in the countries specified for this role.
• Language: Professional fluency in English.
• Programming: Significant hands-on expertise in at least one of Python 3, Java, Rust, Go, C++, or TypeScript.
• Knowledge: Strong understanding of algorithms, data structures, and software engineering principles.
• Experience: Ability to debug complex systems, resolve defects, improve performance, and refactor large or legacy codebases.
• Communication: Ability to explain technical concepts and document engineering decisions clearly.
• Helpful background: Experience delivering features from start to finish in cross-functional projects and interest in how AI systems handle coding challenges.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind systems that learn from examples. Software engineering specialists help by creating and reviewing coding tasks, solutions, and evaluations so models can improve at fixing code, building features, and reasoning about software.