- Prague, Prague, Czech Republic
Own and enhance the AI Gateway, integrate models, manage AI spend, and improve AI tooling across IP Fabric.
Responsibilities
- Own the AI Gateway: follow new releases, ship fixes and features, and keep it reliable for the whole company.
- Deploy and serve open‑source models, and connect third‑party hosted models through the Gateway when they are too large for our infrastructure.
- Aggregate AI spend across our tools, build dashboards on top of the Gateway, and reduce cost through model routing and context compression.
- Make our repositories agent‑ready: write and maintain skills and agent instruction files, improve linters and CI guardrails, and add capabilities to our software factory.
- Support engineers in using AI tools effectively and improve the AI developer experience.
Requirements
- Nice to have: LLM gateways or proxies (LiteLLM, Portkey, or similar)
- Nice to have: Experience serving LLMs (vLLM, Ollama, TGI)
- Nice to have: Experience building MCP servers
- Nice to have: Experience with LLM gateways or proxies
- Nice to have: Experience with usage and cost analytics