Quality Manager - Knowledge AI Required
Oversee, monitor, and elevate the performance of AI-driven customer service tools and hybrid support workflows, acting as the frontline bridge between real-time vendor performance data and client-side engineering, product, and knowledge teams.
- Clark, Pampanga, Philippines
- Full-time
- On-site
- Posted Nov 20, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Operationalize and execute client-approved QA frameworks, evaluation rubrics, and test scripts tailored for AI chatbots, virtual agents, and copilot tools.
- Perform routine pre-release User Acceptance Testing (UAT) and regression testing across prompt deployments, Knowledge Base (KB) updates, and automated workflow releases within the operational environment.
- Conduct daily audits of live AI-driven conversations, automated resolutions, and self-service interactions to detect intent misclassifications, system hallucinations, incorrect policy applications, or journey drops.
- Audit the handover bridge between AI and Human-Assist agents to evaluate context retention, CRM data pass-through accuracy, and agent handle times post-transfer.
- Perform root-cause defect analysis on resolution failures, escalation spikes, and recurring customer friction points.
- Synthesize audit data into actionable weekly reports; feed continuous improvement insights to Client AI Automation Leads, KB Managers, and Product Engineering for system retuning and sprint updates.
- Identify out-of-scope traveler queries and KB content gaps, recommending new intents and articles to safely broaden containment coverage.
- Measure, track, and report on primary operational and AI quality KPIs: Intent Recognition Accuracy, Resolution Precision & Answer Accuracy, Containment Rate & Defect Rate, Handover Context Retention Accuracy, Traveler Sentiment Score (TSS) / CSAT Impact.
- Hold operational teams and frontline agents accountable for adhering to updated AI copilot workflows and knowledge standards.
Requirements
- Experience in a BPO
- Experience in a Travel
Nice to have: Travel Industry Experience, Hospitality Experience, Tech-enabled Customer Support Operations
Skills
Contact Center QAOperational AuditingAI Chatbots TestingConversational AI FluencyNatural Language Processing (NLP/NLU)Root Cause AnalysisLeanSix Sigma5 Whys
Full description
Company details are for members
Sign up for a free job alert to see Sutherland's profile, website and LinkedIn, and the same for every employer on Referso Jobs.