Principal AI Tool Engineer for Software Automation/Testing
Palo Alto Networks · Posted Oct 28, 2026
- California, United States
- On-site
- Full-time · Principal
- $156K–$253K per year
- 8+ years
Design and develop testing frameworks for AI/ML models and LLM applications
Compensation
$156,400.00 - $253,000.00/yr
Responsibilities
- Design and develop testing frameworks for AI/ML models and LLM applications
- Build automated pipelines for model validation, regression testing, and benchmarking
- Create evaluation datasets, synthetic data, and test scenarios for edge cases
- Implement metrics to assess accuracy, robustness, latency, and safety
- Develop tools for prompt testing, output validation, and hallucination detection
Requirements
- Bachelor’s or Master’s degree in Computer Science, AI, Machine Learning, or related field
- Nice to have: LLMs
- Nice to have: prompt engineering
- Nice to have: LangChain
- Nice to have: OpenAI Evals