Legal AI Evaluation Attorney

The work

You will assess complex legal scenarios and review AI-generated legal work. Your feedback will help improve the accuracy, completeness, and reliability of AI systems' legal reasoning.

• Analyze scenarios involving litigation, corporate transactions, regulatory matters, and compliance.
• Identify key legal issues, risks, relevant legal principles, unsupported conclusions, missing information, and weaknesses in reasoning.
• Evaluate AI-generated legal analyses, arguments, contracts, and other legal documents for accuracy and soundness.
• Provide clear, structured feedback and corrections when legal interpretations are ambiguous or competing.

What it pays and takes

This is part-time contract work for candidates in the United States. You must be able to work independently in a remote contractor environment.

• Pay: $100 to $170 per hour.
• Location: Open to candidates in the United States.
• Education: Juris Doctor degree from a U.S. law school.
• License: Active bar license in at least one U.S. state or the District of Columbia.
• Experience: More than three years of substantive legal practice after earning your J.D.
• Skills: Strong legal reasoning, issue spotting, legal writing, document review, attention to detail, and written English communication.

Helpful legal experience

Experience in a range of legal fields can be useful for evaluating different scenarios and documents. Experience reviewing complex legal materials, identifying substantive errors, evaluating competing arguments, or using legal technology and AI-assisted research is also relevant.

• Relevant areas may include litigation, corporate, commercial, employment, personal injury, criminal, family, immigration, insurance, intellectual property, healthcare, securities, real estate, tax, privacy, environmental, and regulatory law.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses human review to help artificial intelligence systems learn from accurate examples and useful feedback. Legal professionals are needed because strong subject-matter judgment helps identify errors and assess whether AI-generated reasoning is sound.