The QA / Evaluation Engineer will work directly with business stakeholders and engineering teams to define, execute and continuously improve testing and evaluation practices for enterprise AI agents and agentic workflows.
Responsibilities
Define and implement testing and evaluation frameworks for AI agents and agentic workflows, covering functional quality, groundedness, safety, reliability, and performance.
Develop and execute test plans, test cases, evaluation criteria, test data, datasets, and benchmark scenarios to ensure consistent and repeatable validation.
Partner with DevOps Agent Engineers and Release / Operations Engineers to validate AI solutions throughout build, integration, pre-production, and deployment phases.
Work with AI Architects to ensure evaluation approaches align with solution design, risk profiles, enterprise standards, and responsible AI requirements.
Own and maintain development and test environments for AI agents, ensuring stability, availability, and alignment with enterprise platform standards.
Visually and mechanically inspects parts, subassemblies and assemblies on all company products to ensure conformance to production specifications and quality standards.
Programs CMM equipment and upgrades software as new releases are received.
Works with QA engineering on inspection system projects such as automating data collection, implementing SPC and gage R&R.
Performs first piece validation of CNC generated parts.
Performs the most complex incoming, first piece, in-process, final floor or bench inspection on a wide variety of parts and products.
Design and maintain scalable quality architecture and test frameworks for Waymo’s autonomous driving systems, ensuring high performance and safety across expanding vehicle platforms and cities.
Locations (2)
Mountain View, California, United States
San Francisco, California, United States
Compensation
$230,000—$284,000 USD
Responsibilities
Design scalable quality architecture and lead QC methodologies for test creation
Develop and manage meta-quality framework and dashboards to improve test accuracy
Drive automation for detection and resolution of test health issues
Create playbook for maintenance adjustments at scale and partner with SMEs to set standards and guidelines
Requirements
Bachelor’s degree in Engineering, Computer Science, Robotics, or other relevant technical field
Seeking a Senior QA Engineer to ensure stability and quality of products for an auto transport platform, leading QA standards and working within an agile team.
Responsibilities
Collaborate with the development team in investigating, reporting, and fixing bugs
As a Quality Assistance Engineer at Voodoo, you will lead our approach to maintain our game health and free of defects, focusing on puzzle or midcore mobile games.
Responsibilities
Conduct comprehensive testing of our mobile games to identify and document crucial defects, taking ownership of the entire QA process to assure quality and user experience
Assist in creating processes and tools to improve the overall quality of the game
Follow the technical KPIs of our live games and propose strategies to continuously improve them
Coordinate closely with design and development teams, understanding game mechanics and providing essential feedback to improve and refine the product
Prioritize and execute testing tasks efficiently at different development stages, aligning with project timelines and objectives while independently addressing and resolving issues found
Staff Systems Test Engineer, Scenario Quality and Maintenance SystemsWaymo · Mountain View, US+1 more
Senior Test Automation EngineerSuper Dispatch · Remote, Uzbekistan
Senior Software Quality Engineer - RollADP · Porto Alegre, Brazil
QA Engineer - Puzzle & Midcore GamesVoodoo · Remote, France