QA Automation Engineer / SDET — AI Prototyping
Define and run a pragmatic, risk-based test strategy across several prototypes built in parallel, building reusable automated checks for APIs, user interfaces and generated documents, and connecting them to CI.
- Remote, Costa Rica
- Contract
- Remote
- Posted Nov 19, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine Learning
Responsibilities
- Define and run a pragmatic, risk-based test strategy across several prototypes built in parallel
- Build reusable automated checks for APIs, user interfaces and generated documents, and connect them to CI
- Maintain versioned reference (golden) datasets with the on-site Product Owner and the client's engineers
- Design checks for AI output: schema validation, bounded acceptance criteria and regression tracking
- Prefer deterministic checks for calculations and code compliance, kept independent of the code under test
- Use AI-assisted test generation, reviewing and owning every test it produces
- Extend regression suites after defects or feature changes, and run them before refactoring
- Report coverage, known limitations and release risk, and support developers with shared fixtures and tooling
Requirements
- Experience in a SaaS
- Experience in a Electrical contracting
- Experience in a Construction
Nice to have: LLM evaluation, Testing document outputs (PDFs, spreadsheets, reports), Engineering codes, Regulated domains
Skills
QA automationSDETTypeScriptPythonAPI testingIntegration testingPlaywrightCI pipelinesAI toolsTypeScriptPythonPlaywrightAWS
Benefits
- Great Place To Work certification
Full description
Company details are for members
Sign up for a free job alert to see Software Mind's profile, website and LinkedIn, and the same for every employer on Referso Jobs.