Emergency Physician AI Evaluation

The work

You will create challenging emergency medicine tasks and assess AI-generated clinical responses. Your reviews will focus on accuracy, patient safety, and current emergency medicine practice.

The work is remote and asynchronous. You will use independent clinical judgment and provide clear written feedback that explains strengths, errors, risks, and ways to improve.

• Create tasks about triage and differential diagnosis for undifferentiated patients.
• Evaluate ECG, imaging, and point-of-care ultrasound interpretations.
• Assess resuscitation, procedural decisions, and patient disposition plans.
• Review AI responses for accuracy, safety, and alignment with emergency medicine standards.
• Explain complex clinical concepts clearly in structured written feedback.

What it pays and takes

This is an ongoing, project-based opportunity that can be completed alongside your current role. The role is remote and available to candidates in the United States.

• Pay: up to $180 per hour.
• Time: 20 or more hours per week.
• Schedule: flexible and asynchronous, with no set schedule.
• Education: MD, DO, or an equivalent medical degree.
• Training: completed residency in emergency medicine.
• License: current medical licensure in the United States.
• Language: professional fluency in English.
• Experience: working knowledge of an emergency medicine area such as POCUS, resuscitation, critical care, trauma, cardiovascular or neurologic emergencies, toxicology, pediatric emergency medicine, or emergency procedures.
• Skills: strong written communication, careful attention to detail, and the ability to explain emergency medicine concepts clearly.
• Helpful background: emergency medicine board certification or eligibility, relevant fellowship training, academic or teaching hospital experience, Level I trauma center experience, peer-reviewed publications, clinical research, or experience with AI-assisted medical tools.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site. OpenTrain is a platform where people find AI training and data-labeling projects, build a profile, and start applications.

About AI training work

AI training is the human work behind systems that generate and evaluate information. Experts review model responses and provide feedback so AI systems can become more accurate, useful, and safe.