Lead quality efforts for machine learning‑powered products and services, building scalable test automation and validation approaches.
Locations (2)
Madison, Wisconsin, United States
Waterloo, Ontario, Canada
Compensation
$152,000—$190,000 USD
Responsibilities
Drive architecture‑level automation solutions and scalable quality engineering practices across multiple teams and product areas.
Design, develop, and maintain automated test frameworks, test scripts for ML inference services and related ML platform components using python/Java
Build and automate realistic, representative test account creations and datasets to evaluate model behavior across different scenarios
Validate score distributions, ranking behavior, output quality, and other model signals for incoming ML models prior to release
Perform functional, integration, regression, API, performance and load testing to verify inference service scalability, latency requirements and reliability under production‑like conditions
Requirements
Bachelor's degree in Computer Science or related field
Nice to have: Experience testing machine learning systems
Nice to have: Synthetic or seeded test data creation
Nice to have: Statistical techniques for model validation
Design and execute multi-platform test strategies, create testing documentation, automate features, mentor junior engineers, and collaborate with cross-functional teams to ensure high reliability and customer success.
Locations (2)
Toronto, Canada
Canada
Compensation
Base pay: $75,000 - $150,000 CAD
Responsibilities
Design and execute multi-platform test strategies covering native mobile (iOS), Windows desktop/web, and hybrid environments
Create comprehensive testing documentation, including test plans, automated scripts, risk assessments, and detailed bug reports
Work closely with product and engineering teams to automate features and maximize regression coverage
Mentor junior Quality Engineers in QA methodologies, automation design patterns, and debugging strategies
Develop deep technical and domain expertise across Veeva’s suite of industry-leading products
QA AnalystPublicis Groupe Holdings B.V · Toronto, Canada
Senior Quality EngineerVeeva Systems · Toronto, Canada+1 more