Counterintelligence Technology & Program SME — AI Evaluation
Xperteez Technology · Posted Nov 19, 2026
- Remote
- Remote
- Contract · Senior
Contribute critical subject matter expertise to a customer's project focused on the development and evaluation of advanced AI systems for security applications, helping to train next-generation AI systems.
Responsibilities
- Author and classify case studies at the counterintelligence boundary, distinguishing legitimate threat detection and analysis from prohibited personal surveillance or attribute-based targeting.
- Apply program and technology-level judgement to assess how counterintelligence capabilities are constructed, authorized, and where outputs may exceed acceptable boundaries.
- Evaluate AI outputs on source handling, analytical reasoning, recognition of limitations, and utility for surveillance or targeting tasks.
- Ensure cases accurately reflect real-world counterintelligence practice, legal authorities, and oversight frameworks, not dramatized scenarios.
- Identify and document instances where AI models improperly reject valid security or threat-analysis queries.
Requirements
- Nice to have: technical CI (TSCM, cyber CI, technical surveillance)
- Nice to have: cross-domain CI/intelligence
- Nice to have: AI evaluation
- Nice to have: wargaming
- Nice to have: red teaming