About this role
Preparing for this role? See the best AI tools for public servants, practise with ready-made prompts for public servants, read AI in Government: The Complete 2026 Guide for Civic Leaders and take the free 30-day AI challenge.
Role type: Contractor
Location: Remote
Commitment: Flexible, project or task-based
Compensation: Typically $50–$100 USD/hour, negotiable based on experience
About the opportunity
our partner is looking for experienced Signals Intelligence (SIGINT) professionals with backgrounds in the National Security Agency (NSA), military intelligence, or allied government intelligence organizations to support customer projects focused on AI training and evaluation. In this role, you'll apply your intelligence expertise to assess AI-generated outputs, develop realistic scenarios, and help establish standards for analytical accuracy and reasoning.
Your expertise will help improve how AI systems interpret intelligence information, understand operational workflows, and approach complex national security scenarios.
What you'll do
- Develop realistic, unclassified SIGINT scenarios and reference materials for AI evaluation tasks.
- Review AI-generated intelligence assessments for technical accuracy, relevance, and analytical quality.
- Create and refine evaluation rubrics to assess AI-generated outputs against established intelligence methodologies.
- Identify gaps, inconsistencies, and errors in SIGINT-related reasoning and operational scenarios.
- Provide structured feedback and collaborate with project teams to improve model performance.
Required qualifications
- Professional experience in government or military Signals Intelligence (SIGINT) operations, collection, or analysis.
- Strong understanding of SIGINT methodologies, intelligence workflows, and analytical practices.
- Ability to assess complex intelligence scenarios and communicate findings clearly.
Preferred qualifications
- Previous experience with the NSA, US intelligence community, or allied government intelligence agencies.
- Expertise in COMINT, ELINT, signals analysis, or cyber intelligence operations.
- Experience preparing intelligence assessments, operational reports, or technical documentation.
- Familiarity with intelligence training, quality evaluation, or analytical review processes.
- Exposure to AI evaluation, model testing, or rubric development is a plus.
Application process
- Candidates will complete an AI interview as part of the application process.
Learn More About Our Government & Defense Work
At our partner, we work with government and defense experts to evaluate how advanced AI models perform on real-world tasks.
Our MissionReport benchmark assesses AI-generated military and government reports, highlighting the importance of expert judgment, accuracy, and operational understanding.
Learn more: https://www.our partner/benchmark/mission-report
This is a 100% remote contract role, open to applicants worldwide in the countries the employer accepts.
