QA Analyst - AI
Join a team ensuring the quality and reliability of AI-powered applications, combining solid manual and functional testing with a strong understanding of AI/ML systems.
- Porto, Portugal +1 more
- Full-time
- Hybrid
- Posted Nov 17, 2026
INDUSTRYSoftware & InternetAI & Machine Learning
Locations (2)
- Porto, Portugal
- Lisbon, Lisbon District, Portugal
Responsibilities
- Create test strategies and test plans for AI/ML-based systems
- Design, execute and maintain manual and exploratory test cases (functional, non-functional and AI-specific: model behavior, edge cases, bias, explainability)
- Analyse the backlog to assess testing feasibility and contribute to the test strategy
- Participate in test effort estimation and risk identification, considering model uncertainty and data variability
- Support UAT, ensuring business requirements are reflected in AI outputs
- Review and analyse test results, including model outputs, prediction accuracy and regression impacts
- Report bugs, validate fixes and monitor model performance over time
- Prepare test status and issue status reports
- Validate AI model correctness, robustness, fairness and explainability
- Design and run data quality checks and data pipeline validation scenarios
- Challenge AI model requirements and acceptance criteria with product owners, and help define AI quality metrics and KPIs (accuracy, precision, etc.)
- Take part in Agile Scrum ceremonies and support more junior analysts
Requirements
Nice to have: French
Skills
AI/MLJiraXraySoapUIPostmanSQLPythonPlaywrightSeleniumKatalonJiraXraySoapUIPostmanSQLPythonPlaywrightSeleniumKatalon
Full description
NimberCompany details are for members
Sign up for a free job alert to see Nimber's profile, website and LinkedIn, and the same for every employer on Referso Jobs.