Back to search

Principal Applied Sciences Manager

Lead an applied science team focused on post‑training and inference optimization for large language models, driving research into production capabilities.

  • Bangalore, Karnataka, India
  • Posted Nov 9, 2026
INDUSTRYSoftware & InternetAI & Machine Learning

Responsibilities

  • Hire, coach and manage applied scientists
  • Set clear goals, give performance feedback and develop technical leaders
  • Own the science roadmap across post‑training and inference optimization
  • Lead supervised fine‑tuning, preference optimization and reinforcement learning
  • Build data and feedback pipelines with engineering teams
  • Establish reproducible evaluations with strong baselines
  • Lead inference experiments in quantization, distillation and speculative decoding
  • Partner with systems engineers on distributed training and agent rollout
  • Take successful experiments into production through staged releases, monitoring and rollback plans

Requirements

  • Master's Degree in Computer Science, Machine Learning, Statistics, Engineering or a related technical field
  • Bachelor's Degree in a related technical field

Nice to have: agent post‑training, reward modeling, preference learning, reinforcement learning, training toolchains such as verl or TRL, serving runtimes such as vLLM, SGLang or TensorRT‑LLM, co‑designing model improvements and serving optimizations across model families or hardware platforms

Skills

PythonPyTorchJAXmachine learningoptimizationstatisticsexperimental designdistributed trainingGPU serving bottlenecksPyTorchJAXvLLMSGLangTensorRT‑LLM

Full description

Overview Principal Applied Science Manager - Post-Training and Inference Optimization Overview Microsoft Foundry helps developers and organizations build, deploy and operate AI solutions at scale. Join an engineering team building the infrastructure that makes model training and inference faster, more reliable and more efficient for customers. As a Principal Applied Science Manager, you will lead an applied science team improving model and agent quality through post-training and reducing inference latency and cost. You will set scientific direction, develop scientists and remain hands-on in experiments and code. Partner with training, serving and product teams to turn research into reliable customer capabilities, measured by task success, response time and cost per successful task. Microsoft’s mission is to empower every person and every organization on the planet to achieve more, and we’re dedicated to this mission across every aspect of our company. Our culture is centered on embracing a growth mindset and encouraging teams and leaders to bring their best each day. Join us and help shape the future of the world. Responsibilities Responsibilities Hire, coach and manage applied scientists. Set clear goals, give performance feedback and develop technical leaders who can take research through to production. Own the science roadmap across post-training and inference optimization. Translate customer needs into testable hypotheses, prioritize experiments and make investment decisions using measured quality and cost improvements. Lead supervised fine-tuning, preference optimization and reinforcement learning (RL). Develop reward models and task-based reward signals that improve reasoning, multi-turn task completion and tool-use correctness. Build data and feedback pipelines with engineering teams. Curate demonstrations, preference data, synthetic examples and agent interaction histories, with clear data permissions, versioning and separation between training and evaluation data. Establish reproducible evaluations with strong baselines and controlled comparisons. Measure generalization and safety, prevent evaluation-data leakage and detect models exploiting rewards without completing the intended task. Lead inference experiments in quantization, distillation and speculative decoding to reduce computation and memory use. Measure time to first token, generation speed, tail latency, throughput and cost under representative load, against explicit model-quality targets. Partner with systems engineers on distributed training, agent rollout generation, batching and caching. Reduce training GPU-hours and serving cost while preserving convergence, task quality and reliable recovery. Take successful experiments into production through staged releases, monitoring and rollback plans. Work with engineering teams to preserve data privacy, tenant isolation, streaming behavior and token-accounting correctness. Qualifications Required Qualifications Master's Degree in Computer Science, Machine Learning, Statistics, Engineering or a related technical field AND 8+ years of relevant applied science, machine learning or engineering experience; OR Bachelor's Degree in a related technical field AND 10+ years of relevant experience; OR equivalent experience. Experience managing applied scientists or machine learning researchers, including hiring, coaching, performance management and delivery through a team. Hands-on experience delivering both large language model post-training and inference optimizations, with measured improvements in model quality, latency or cost. Strong Python and practical experience with PyTorch, JAX or comparable frameworks. Strong foundations in machine learning, optimization, statistics and experimental design. Understanding of distributed training and GPU serving bottlenecks, including compute, memory and communication trade-offs. A record of turning research into production capabilities with engineering and product partners, and explaining technical trade-offs clearly. Preferred Qualifications Experience with agent post-training, reward modeling, preference learning or RL systems that improve held-out task success. Experience with training toolchains such as verl or TRL, and serving runtimes such as vLLM, SGLang or TensorRT-LLM. Experience co-designing model improvements and serving optimizations across model families or hardware platforms. Research, open-source or production contributions that demonstrate reproducible scientific results and practical customer impact. This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Principal Applied Sciences Manager at Microsoft | Referso Jobs