Lead Software Engineer- AI Agent Developer
Lead Software Engineer (AI/ML) to build and operate scalable autonomous agent systems.
- Bengaluru, Karnataka, India
- Posted Nov 3, 2026
INDUSTRYSoftware & InternetAI & Machine Learning
Responsibilities
- Architect and ship autonomous agent systems that are scalable, resilient, and production-grade (latency, reliability, security, and uptime).
- Design agentic architectures (planner/executor patterns, multi-agent orchestration, tool use, retrieval, and workflow execution).
- Build robust tool interfaces and tool ecosystems (APIs, function calling patterns, permissions, and safe execution).
- Engineer context, memory, and state management strategies (short/long-term memory, summarization, retrieval, grounding, and caching).
- Own model evaluation and quality measurement (offline/online evals, regression testing, and failure-mode analysis).
- Implement end-to-end observability for LLM systems (tracing, metrics, logging, prompt/tool telemetry, incident response).
- Drive cost and performance optimization across models and infrastructure (throughput, batching, caching, routing, quantization, and inference efficiency).
- Mentor engineers and set engineering standards for production AI systems (code quality, design reviews, and operational excellence).
Requirements
Nice to have: planner/executor patterns, multi-agent orchestration, tool-use design, retrieval workflows, prompting strategies, tool-augmented generation, model behavior understanding, short/long-term memory, summarization, retrieval grounding, caching strategies, Neo4J, Open Knowledge Formats (OKFs), vector databases, hybrid search patterns
Skills
PythonJavaGoTypeScriptLLM/agentic systemsfoundation modelsLLM behaviorprompting strategiestool-augmented generation patternsKnowledge graph (Neo4J)Open Knowledge formats (OKFs)context and memory engineeringmodel evaluation methodologiesquality measurementobservability for distributed systemstracingmetricslogsdashboardsalertingon-call readinessretrieval systemsvector databaseshybrid search patterns
Full description
Company details are for members
Sign up for a free job alert to see JPMorgan Chase & Co.'s profile, website and LinkedIn, and the same for every employer on Referso Jobs.