Kotlin AI Response Evaluator

The Work

You will evaluate AI-generated Kotlin responses and help improve how models handle software engineering tasks. Your work will cover Android development, backend engineering, coroutines, null safety, Ktor, Android Jetpack, software architecture, and LLM-assisted coding.

• Review Kotlin answers for correctness, reasoning quality, technical soundness, and prompt adherence.
• Write expert Kotlin explanations and model solutions that show the correct approach.
• Fact-check technical claims and identify errors in methods or concepts.
• Rate and compare responses for accuracy, clarity, and problem-solving quality.
• Create prompts and responses that support AI learning across Kotlin and software engineering topics.
• Test AI models for inaccuracies, bias, and reliability across different use cases.

What It Pays And Takes

This is remote, part-time contract work with a 20+ hour weekly commitment. The role is open to candidates in the countries listed below and requires professional English writing skills.

• Pay: $55 per hour.
• Work arrangement: Remote, part-time contract.
• Time requirement: 20+ hours per week.
• Location: Open to candidates in Bangladesh, Bhutan, Brazil, Cambodia, Germany, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, the Philippines, the United States, Timor-Leste, and Vietnam.
• Experience: At least 2 years of hands-on Kotlin development experience.
• Technical skills: Strong knowledge of Kotlin null safety, coroutines, and functional programming idioms.
• Professional background: Kotlin software engineering experience in Android or backend services.
• Education: Bachelor's degree in Computer Science or a closely related field.
• Evaluation skills: Ability to assess idiomatic Kotlin style, design choices, and architecture trade-offs.
• Additional experience: Using large language models for coding, debugging, or code review.
• Helpful background: Production experience with Ktor, Android Jetpack, or advanced coroutines; merged pull requests in Kotlin open-source projects; competitive programming; or prior AI data training, model evaluation, or app-logic review.

How It Works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI Training Work

AI training work is the human side of building artificial intelligence. People review and improve model responses, and contributors with strong technical knowledge help models produce more accurate and useful results.