Compliance Law AI Evaluator

The work

You will use your compliance-law judgment to review documents and evaluate AI-generated legal content. The work requires careful analysis of accuracy, reasoning, ambiguity, legal risk, and compliance with U.S. standards.

• Review and annotate legal documents and compliance materials used to develop AI systems.
• Evaluate AI-generated legal responses for accuracy, reasoning quality, and adherence to U.S. compliance standards.
• Write explanations, rationales, scenario-based questions, and answers for complex compliance situations.
• Identify unclear reasoning, regulatory risks, and potential legal pitfalls in AI-generated responses.
• Suggest precise improvements and provide feedback on AI training processes.
• Work remotely with project leads and technical specialists on detailed compliance and regulatory questions.

What it pays and takes

This is a remote, part-time contractor role for compliance attorneys. The role requires current compliance-law practice and strong written and verbal communication.

• Pay: $100 to $170 per hour equivalent, paid per task that meets project specifications.
• Location: Open to candidates in the United States.
• Language: Professional fluency in English.
• Education: Juris Doctor degree from an accredited U.S. law school.
• Licensing: Active attorney license in good standing.
• Experience: Three to ten or more years of recent, substantive compliance-law practice in the United States.
• Knowledge: Strong understanding of U.S. compliance and regulatory issues.
• Communication: Ability to explain complex legal concepts clearly and concisely.
• Valued background: Judicial clerkship experience, law or legal-writing teaching at an accredited law school, or legal-journal editorial experience.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training work uses human review to help artificial intelligence learn from accurate examples and useful feedback. Compliance attorneys are paid for this work because their legal judgment helps assess model responses, explain complex issues, and identify risks that general review may miss.