- Toronto, Canada
- Full-time · Mid
- CA$102K–CA$152K per year
- 1–4 years
Designs, develops and deploys the evaluation and trust capabilities of Equinix's GenAI platform, building features for agent evaluation, trust controls, and root‑cause analysis.
Compensation
The targeted pay range for this position in the following location is / locations are: Canada - Toronto Office TRO : 102,000 - 152,000 CAD / Annual
Responsibilities
- Build platform features for evaluation: dataset creation and versioning, golden datasets, synthetic test data and reusable metric templates
- Build scoring for agents: code‑based checks, LLM‑as‑judge, tool‑call accuracy and grounding checks
- Build human‑review features that compare judge scores against human reviewers, and recalibrate when agreement is low
- Run evaluations at scale: before release, on every change to a prompt, model or tool, and on agents in production
- Build evaluation playbooks so agent builders can evaluate their agents without specialist help
Requirements
- Bachelor's degree in computer science, engineering, data science, mathematics or a related field
- Nice to have: evaluation or observability features used by many teams or at scale
- Nice to have: LLM evaluation and observability tools
- Nice to have: OpenTelemetry
- Nice to have: red‑teaming or adversarial testing of LLM systems