LLM Evaluation Specialist

The work

You will test large language models and assess how well they perform. The work involves careful judgment, accurate instruction-following, and independent review in a primarily asynchronous remote setting.

• Test large language models as part of AI training projects.
• Use general academic knowledge and reasoning to evaluate model performance.
• Review model behavior carefully and help identify ways to improve system performance.
• Follow detailed instructions accurately while completing evaluation tasks.
• Work independently in a remote, primarily asynchronous environment.

What it pays and takes

This is a remote, part-time freelance role involving short-term AI training projects. People from any academic discipline may apply, and no professional AI training experience is required.

• Pay: $17 per hour.
• Time: 20 or more hours per week.
• Location: Open to candidates in the United States.
• Language: Fluent English.
• Education: Current enrollment in an associate, bachelor's, or master's program, or completion of a degree.
• Skills: Strong reasoning, exceptional attention to detail, and consistent accuracy when following instructions.
• You should be comfortable working independently and learning new evaluation workflows through brief training.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind modern AI systems. Contributors review language-model responses and prepare feedback that helps models become more accurate, useful, and reliable. OpenTrain helps people find these projects, build a profile, and grow experience in the field.