Philosophy Quality Assurance Lead

The work

You will oversee quality across philosophy-focused AI training projects. This includes reviewing AI-generated content, trainer work, and QA work against project guidelines and rubrics.

You will also help keep remote review teams aligned by identifying recurring issues, sharing updates, maintaining documentation, and improving review workflows as projects change.

• Review explanations of philosophy, argument analyses, ethical reasoning, philosopher summaries, logic problems, and conceptual comparisons.
• Check work for conceptual accuracy, argument structure, logical validity, context, interpretation, clarity, nuance, formatting, and instruction-following.
• Evaluate trainer and QA work for accuracy, rigor, and alignment with project rubrics.
• Write clear feedback, escalate recurring or critical quality issues, and communicate quality expectations to contributors.
• Support onboarding, training calls, calibration materials, documentation, and process improvements.
• Help identify inactive contributors and keep quality workflows moving across remote expert teams.

What it pays and takes

This is a remote, part-time contractor role for an expert-level philosophy reviewer. The role requires strong written English and the ability to give precise feedback to remote contributors.

• Pay: Up to $65 per hour.
• Time: 20+ hours per week.
• Location: United States.
• Language: English.
• Background: Philosophy, ethics, logic, political theory, humanities, religious studies, classics, cognitive science, or a closely related field.
• Experience: At least 3 years in philosophy research, teaching, writing, editing, academic review, ethics review, logic instruction, or related humanities work.
• Judgment: Identify strawman arguments, invalid inferences, conceptual confusion, oversimplification, unsupported claims, false equivalence, and misrepresentation of philosophers' views.
• Tools: Comfort with Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
• Helpful experience: AI training, data annotation, large language model evaluation, academic QA, ethics review, or rubric-based review.

How it works

Apply on OpenTrain with your resume and then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that understand and generate text. People review examples, rate model responses, and provide expert feedback so AI systems produce more accurate and useful results.