IT Developer - LLM Engineer
Design, evaluate, optimize, and operationalize enterprise AI systems across the complete model lifecycle.
- Nanakramguda, Telangana, India
- Posted Nov 11, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Design and implement training, fine-tuning, and adaptation pipelines for open-weight Large Language Models using supervised fine-tuning, LoRA, QLoRA, and Parameter-Efficient Fine-Tuning (PEFT) techniques.
- Build and curate high-quality datasets from operational data sources, incidents, runbooks, logs, knowledge articles, and validated interactions for model training and evaluation.
- Develop model evaluation frameworks covering reasoning, instruction following, hallucination detection, tool calling, safety, robustness, and structured output quality.
- Evaluate and optimize retrieval-augmented generation systems through retrieval analysis, embedding model comparison, reranking, chunking strategies, and groundedness assessment.
- Design and execute agent and tool-calling benchmarks that measure task completion, tool selection accuracy, failure recovery, and operational safety.
- Optimize model serving performance through quantization, batching strategies, cache management, inference tuning, and serving-stack evaluation.
- Implement experiment tracking, model governance, lineage management, release gating, and deployment workflows using enterprise MLOps practices.
- Establish production monitoring, quality drift detection, observability metrics, security testing, and rollback criteria for deployed AI solutions.
Requirements
- Bachelor's Degree in Engineering
- MCA
- MSc
Nice to have: direct preference optimization (DPO), TRL, DeepSpeed, Fully Sharded Data Parallel (FSDP), distributed training techniques, vLLM, NVIDIA TensorRT-LLM, SGLang, RAGAS, DeepEval, TruLens, AI Ops, IT service management, incident management, observability platforms, knowledge systems, automated remediation workflows, OpenTelemetry, Prometheus, Grafana
Skills
PythonPyTorchHugging Face TransformersDatasetsPEFTmodel fine-tuningLinuxDockerKubernetesGitREST APIscloud or GPU-based model deploymentMLflowWeights & BiasesLarge Language Model evaluationretrieval-augmented generationmodel benchmarkingexperiment trackingMLOps practicesmodel servingquantizationbatchingcache managementinference tuningserving-stack evaluationmodel governancelineage managementrelease gatingdeployment workflowsproduction monitoringquality drift detectionobservability metricssecurity testingrollback criteriaPythonPyTorchHugging Face TransformersDatasetsPEFTLinuxDockerKubernetesGitREST APIsMLflowWeights & BiasesvLLMNVIDIA TensorRT-LLMSGLangRAGASDeepEvalTruLensOpenTelemetryPrometheusGrafana
Benefits
- competitive Salary
- flexible Benefits Package
Full description
Company details are for members
Sign up for a free job alert to see Medtronic's profile, website and LinkedIn, and the same for every employer on Referso Jobs.