Lead the architecture, optimization, and operational excellence of ServiceNow's AI inference platform, owning the end-to-end inference lifecycle and building intelligent gateway layers.
For positions in this location, we offer a base pay of $181,200 - $317,100, plus equity (when applicable), variable/incentive compensation and benefits.
- Own the end-to-end inference lifecycle from onboarding models to deploying optimized inference engines in production across multiple backends on Kubernetes infrastructure
- Architect the intelligent gateway layer using Envoy and ext_proc to enforce access control, provide observability, and enable advanced request routing
- Build and evolve the AI platform and partner with teams to build products and end-to-end AI-powered work experiences
- Lay foundations, research, experiment, and de-risk AI technologies that unlock new work experiences in the future
- Bachelor’s degree in computer science, software engineering, or a closely related technical field
AI Infrastructure Global Technical Sales LeadGoogle · Austin, US+4 more
Senior Customer AI Engineer - Token FactoryNebius · Tel Aviv, Israel