AI Agent Workflow Evaluator

The Work

You will test AI assistants such as ChatGPT and Claude by running realistic, multi-step business workflows. You will compare each step with practical workplace requirements and document whether the assistant produces useful, complete, relevant, and reliable results.

• Run complex business scenarios that reflect professional workflows.
• Record each step so the process can be reviewed and repeated.
• Score AI-generated outputs using defined rubrics and evaluation criteria.
• Write clear, constructive feedback that identifies specific improvements.
• Track recurring strengths, weaknesses, and process opportunities in AI behavior.
• Connect AI assistants with tools such as Google Drive, Gmail, Slack, and Notion.
• Maintain accurate written records that support transparency and reproducibility.

What It Pays and Takes

This is a remote, part-time contractor role. The listing is marked entry level, and prior AI-training experience is not required.

• $30 to $90 per hour.
• Remote work open to candidates in the United States, Canada, or the United Kingdom.
• The United States is strongly preferred.
• Professional experience in a business function where technology is used to solve operational challenges.
• A completed bachelor's degree or higher in any discipline.
• Daily, hands-on professional use of ChatGPT, Claude, or both.
• Experience creating, applying, or reviewing evaluation rubrics, quality-assurance scorecards, grading criteria, or content-review guidelines.
• Comfort connecting AI tools with business software and productivity platforms.
• Excellent written English and the ability to produce precise, actionable documentation.

Helpful Background

Experience with academic grading, quality assurance, hiring scorecards, content moderation, annotation guidelines, or AI model evaluation can help. Familiarity with documenting multi-step processes and judging outputs for quality, completeness, and relevance is also useful.

How It Works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI Training Work

AI training is the human work behind systems that learn from examples, including reviewing model responses and rating how well AI handles real tasks. People with relevant professional experience help define useful standards and identify where AI needs to improve.