QA Engineer to validate AI-powered analytical solutions where Agents use Databricks Genie to interpret natural-language questions and generate data-driven insights, focusing on data accuracy, response quality, business logic, and end-to-end reliability.
Responsibilities
Test AI Agents and analytical solutions powered by Databricks Genie
Validate natural-language questions and Genie-generated analytical responses against source data and SQL results
Test analytical scenarios including KPIs, aggregations, trends, comparisons, filters, and drill-downs
Validate responses across different question phrasings, ambiguous queries, edge cases, and multi-turn conversations
Identify incorrect calculations, inconsistent responses, hallucinations, and incorrect interpretation of business terminology