Lead Software Development Engineer in Test - AI
Take ownership of quality engineering strategy across a rapidly evolving AI-driven product ecosystem. Define and implement scalable testing approaches, architect reusable automation frameworks, and establish quality standards that support reliable and high-performing AI solutions.
- Remote, India
- Full-time
- Remote
- Posted Nov 11, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningData & Analytics
Responsibilities
- Define and lead the overall Quality Assurance (QA) strategy for AI products and engineering initiatives.
- Architect, develop, and implement large-scale, reusable, and cross-platform test automation frameworks.
- Take end-to-end ownership of the quality charter for the AI vertical, ensuring consistency, reliability, scalability, and performance across products.
- Drive organization-wide quality engineering initiatives and establish standardized testing methodologies and best practices.
- Design and implement scalable testing strategies for AI-powered systems, covering Retrieval-Augmented Generation (RAG), hallucinations, model drift, bias, and other AI-specific quality challenges.
- Establish testing approaches that evaluate AI model behavior, accuracy, reliability, and consistency under different scenarios and operating conditions.
- Own key technical decisions related to test strategies, automation tools, frameworks, and AI testing methodologies.
- Shape and execute the AI quality roadmap, identifying opportunities to reduce technical risks and improve product reliability and scalability.
- Collaborate with cross-functional teams, including Software Engineering, Product, and Architecture, to align quality initiatives with technical and business objectives.
- Participate in architectural discussions and influence engineering decisions to ensure quality is integrated throughout the software development lifecycle.
- Lead, coach, and mentor the QA/SDET team, strengthening technical capabilities and encouraging continuous learning.
- Establish engineering standards, promote knowledge sharing, and support the development of a strong technical talent pipeline.
- Monitor quality metrics, identify systemic risks, and implement continuous improvement initiatives across the AI product ecosystem.
Requirements
- Experience in a AI
Nice to have: Machine Learning Operations (MLOps) pipelines, performance testing, load testing, scalability testing
Skills
AI tools and model testingRetrieval-Augmented Generation (RAG)hallucination detectionmodel driftbias evaluationtest automation frameworksCI/CD pipelinesAWSGoogle Cloud Platform (GCP)Microsoft AzureAWSGoogle Cloud Platform (GCP)Microsoft Azure
Benefits
- Fully remote working arrangement within India
- Competitive compensation package
- Opportunity to lead AI quality engineering initiatives and influence organization-wide testing strategies
- Exposure to advanced AI technologies, model testing methodologies, and large-scale automation frameworks
- Opportunity to shape the quality roadmap for innovative AI-powered products
- Leadership opportunities, including mentoring engineers and developing high-performing technical teams
- Collaboration with globally distributed, cross-functional engineering teams
- Opportunities for continuous learning, technical growth, and professional development
- Exposure to modern cloud technologies, CI/CD practices, and emerging MLOps capabilities
- An innovation-driven environment that encourages ownership, technical excellence, and continuous improvement
Full description
JobgetherCompany details are for members
Sign up for a free job alert to see Jobgether's profile, website and LinkedIn, and the same for every employer on Referso Jobs.