Psychology Expert for LLM Evaluation

The work

You will help evaluate large language models, or AI systems that generate text. Your work will focus on psychology topics and on whether model responses explain specialized concepts accurately and clearly.

The work is remote and asynchronous, with flexible participation and assignments based on project availability.

• Create prompts that test knowledge of psychology concepts and specialized areas.
• Evaluate AI-generated responses for quality and accuracy.
• Research psychology topics with assistance from AI tools.
• Complete tasks that test scientific and language understanding.
• Use psychology and research judgment when comparing model responses with accurate domain knowledge.

What it pays and takes

This is a part-time contractor role for someone with advanced psychology knowledge and specialized disciplinary or research expertise. Experience creating domain-specific prompts, evaluating AI responses, or conducting psychology research may help you contribute effectively.

• Pay: Up to $55 per hour.
• Time: Less than 20 hours per week.
• Location: Open to candidates in the United States.
• Language: Fluent in English.
• Education: A master's degree from a US institution is required.
• Requirements: Advanced psychology knowledge, clear explanation skills, independent work habits, and strong judgment when assessing model responses.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind artificial intelligence, including writing prompts and reviewing model responses. OpenTrain is a free platform where people find AI training and data-labeling projects, build a profile, and apply to opportunities in one place.