Lead and support multi-country quantitative evaluations for the ECAMENA Regional Office, providing technical leadership, capacity building, and strategic guidance.
Responsibilities
Provide technical leadership and direct support to country programme evaluations
Guide country offices in conducting high-quality strategic evaluations
Contribute to regional evaluation work and capacity development
Support systematic use of evaluative evidence for accountability and decision-making
Requirements
Master or equivalent in Economics, Data Sciences, Statistics or related field
Lead AI research to advance cybersecurity capabilities of large language models and autonomous AI agents through post‑training, evaluation, and environment design.
Compensation
$163,200.00 - $264,000.00/yr
Responsibilities
Develop high‑quality security data, realistic training and evaluation environments, reliable graders, and post‑training methods for complex cybersecurity tasks spanning vulnerability research, threat analysis, detection, investigation, remediation, secure coding, and autonomous security workflows.
Design reproducible training and evaluation environments for complex cybersecurity tasks.
Transform source‑code repositories, vulnerabilities, security incidents, malware samples, threat intelligence, detection logic, patches, test harnesses, and security tools into structured tasks for LLMs and AI agents.
Build reliable graders, verifiers, and reward signals using tests, compilation, runtime behavior, security‑tool outputs, detection results, vulnerability reproduction, and other domain‑specific validation methods.
Design evaluations for security reasoning, code understanding, threat analysis, root‑cause analysis, tool use, long‑horizon execution, and autonomous task completion.
Requirements
BS/MS degree in Computer Science, Machine Learning, Artificial Intelligence, Cybersecurity, or a related field, or equivalent practical experience.
Evaluation Specialist (Multi-country)UNICEF · Istanbul, Turkey