Cyber Threat Intelligence AI Evaluation SME

The work

You will help evaluate AI systems that assess advanced cyber threat scenarios. The work focuses on setting clear boundaries between legitimate defensive analysis and impermissible surveillance, attribution, or intrusion-related requests.

You will create evaluation cases, grade model responses, document difficult edge cases, and give clear written and verbal feedback.

• Map cyber threat intelligence cases to established taxonomies, especially for surveillance and privacy evaluation.
• Write boundary cases involving prohibited surveillance, attribution, and intrusion-adjacent requests.
• Evaluate responses for source reliability, analytic reasoning, stated limitations, and actionable value.
• Identify over-refusal when an AI system unnecessarily declines legitimate threat analysis.
• Document edge cases involving nation-state operations and advanced threats.
• Give concise written and verbal feedback to improve AI threat assessment.

What it pays and takes

This is part-time contractor work for specialists who can apply practical cyber threat intelligence expertise to structured AI evaluation and feedback tasks.

• $70 to $110 per hour.
• Part-time contractor role.
• Open to candidates in the listed countries across the Americas, Europe, Asia, Africa, and the Middle East.
• Professional fluency in English, with clear structured writing and verbal communication.
• Substantial professional experience in cyber threat intelligence involving nation-state operations or advanced threats.
• Strong judgment about defensive or analytic activity versus offensive or surveillance-focused requests.
• Experience with threat-actor attribution, APT tracking, or adversary tactics and techniques.
• Experience mentoring, teaching, or leading threat intelligence professionals is valuable.
• Experience level: Entry level listing.
• Prior AI evaluation, red-teaming, or related quality assurance experience is helpful but not required.

How it works

Apply on OpenTrain with your resume, then complete the application on the hiring site.

About AI training work

AI training is the human work behind systems that learn from examples, including reviewing model answers and rating their quality. In this role, cyber threat intelligence expertise helps assess whether AI responses are accurate, useful, and appropriately limited.