- София, Bulgaria +1 more
- Full-time · Senior
- 5+ years
Build and run on‑premise and cloud LLM platforms, deploy and serve open‑weight models, optimize GPU usage, and administer the platform as it grows.
Locations (2)
- София, Bulgaria
- Egypt, Bulgaria
Responsibilities
- Design and build on‑premise and cloud environments for hosting LLMs
- Deploy, serve and scale open‑weight models behind standard APIs
- Optimize models and serving configuration for throughput, latency and GPU cost
- Administer the platform: upgrades, capacity planning, access control, quotas and the model catalog
- Monitor performance, GPU utilization, usage and cost
Requirements
- Nice to have: LLM gateways and routing (e.g. LiteLLM)
- Nice to have: LLM observability