Legal AI Evaluation Expert

The work

You will review AI-generated legal analyses and other expert legal content. Your feedback will help improve how AI systems reason about legal questions.

The work involves checking accuracy, clarity, citations, legal rules, issue spotting, and the quality of explanations and model solutions.

• Review AI-generated legal analyses and expert legal content.
• Assess reasoning quality, issue spotting, and whether each response follows the prompt.
• Fact-check citations, legal rules, and doctrinal statements.
• Write clear feedback, explanations, and model solutions.
• Compare and rank responses by correctness and reasoning quality.
• Identify inaccuracies, bias, and weaknesses in model outputs.

What it pays and takes

This is a remote, part-time contractor role for people with legal or closely related academic backgrounds. The listing describes the role as entry level, but it requires broad legal knowledge and strong analysis skills.

• Pay: $40 to $115 per hour.
• Time: 20 or more hours per week.
• Work arrangement: Remote contractor, part time.
• Location: Applicants may be based in Bangladesh, Bhutan, Cambodia, Germany, India, Indonesia, Malaysia, Nepal, Pakistan, Singapore, Sri Lanka, Thailand, the Philippines, the United States, Timor-Leste, or Vietnam.
• Language: English at minimum C1 proficiency.
• Education: A law degree or equivalent background in law, legal studies, public policy, or political science.
• Knowledge: Constitutional law, contracts, torts, criminal law, civil procedure, and regulatory or administrative law.
• Skills: Legal reasoning, statutory interpretation, case analysis, fact-to-issue analysis, and careful review of citations, jurisdiction, procedure, and logical consistency.
• Preferred experience: AI data training, expert review, legal editing, or quality assurance.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that generate and evaluate text. Reviewers check model responses, explain what is wrong or strong, and help shape more accurate AI behavior; specialized legal knowledge is valuable for this type of work.