Software EngineerProgressive Automations · Posted Nov 9, 2026Copy linkOpenMexicoMX$65K–MX$105K per monthApply with Referso
Principal Software Engineer - AI Runtime & Distributed Inference SystemsInternational Recruiting LLC · Posted Nov 7, 2026Copy linkOpenSan Jose, California, United StatesPrincipal12+ yearsApply with RefersoAIApply on careers pageLead the architecture of large-scale AI inference systems and distributed runtimes.ResponsibilitiesDefine the software architecture for large-scale AI inference systemsLead the evolution of the distributed runtime stack for dense and MoE foundation modelsEstablish long-term technical strategy for performance, scalability, reliability, and programmabilityInfluence hardware-software co-design decisions across future accelerator generationsArchitect runtime systems supporting tensor, pipeline, expert, data parallelism and multi-rack inference executionRequirementsBS, MS, or PhD in Computer Science, Computer Engineering, Electrical EngineeringNice to have: large language model serving systemsNice to have: vLLMNice to have: SGLangNice to have: TensorRT-LLMSkillsC++Rustsystems programmingdistributed systemsAI inference systems
