Associate, Digital Operations
LLM / AI Red-Team Evaluator executing AI red Teaming adversarial evaluation pilot.
- Hyderabad, Telangana, India
- Full-time
- On-site
- Posted Nov 20, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningData & Analytics
Responsibilities
- Formulate risk hypotheses, design creative adversarial scenarios, and execute multi-turn, adaptive prompt attacks on authorized systems.
- Critically evaluate model outputs for grounding errors, source contradictions, stale information, and trust-boundary violations (such as indirect prompt injections).
- Capture, package, and document complete, reproducible evidence including exact prompt sequences, session/version context, and timestamps.
- Submit detailed finding cards for QA and calibrate judgments based on updated rubrics and guidelines.
- Separately classify candidate findings, quality issues, and inconclusive outcomes, knowing exactly when to stop and escalate unsafe or uncertain cases.
- Meet or exceed pre-production certification targets (including achieving a ≥85% agreement rate on adjudicated practice sets with zero material omissions).
- Maintain strong ownership of assigned attack surfaces and test surfaces within client-approved boundaries.
- Stay informed of client taxonomies, system changes, policy revisions, and evolving risk definitions.
- Collaborate with cross-functional teams including the Red-Team Team Lead, Project Manager, and QA analysts to resolve challenges constructively.
Requirements
- Graduate/ Undergraduate
- Experience in a AI
Nice to have: Analytical capability, Skeptical capability, Troubleshooting capability
Skills
AI Red TeamingAdversarial AIPrompt InjectionJailbreak TestingResponsible AIAI GovernanceAI SafetyLLM EvaluationModel EvaluationRLHF (Reinforcement Learning from Human Feedback)Human FeedbackPrompt EngineeringGenAI TestingAI QA
Full description
CNXCompany details are for members
Sign up for a free job alert to see CNX's profile, website and LinkedIn, and the same for every employer on Referso Jobs.