Staff Software Engineer, Applied AI
Build and scale the backend systems that power LLM applications in healthcare, focusing on APIs, pipelines, and infrastructure for reliable, secure, and cost-efficient LLM production.
- Burlingame, California, United States
- Full-time
- On-site
- $200K–$275K per year
- Posted Nov 8, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for healthcare use cases.
- Build ingestion, preprocessing, and retrieval-augmented generation (RAG) pipelines to ground LLMs in clinical and revenue-cycle data.
- Design systems for model monitoring, evaluation, cost tracking, and guardrails, ensuring reliability and responsible use.
- Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments.
- Implement HIPAA-ready infrastructure, data governance, and auditability for LLM-powered applications.
- Partner with product, ML engineers, and healthcare experts to translate business workflows into robust backend systems.
- Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in LLM system design.
Requirements
- Experience in a Healthcare
- Experience in a SaaS
Nice to have: FHIR, HL7, HIPAA, RAG pipelines, Vector databases, Structured-output orchestration, Enterprise SaaS, Responsible AI
Skills
Benefits
- Health insurance
- Dental coverage
- Vision coverage
- Equity options
More jobs nearby
Full description
SuperDialCompany details are for members
Sign up for a free job alert to see SuperDial's profile, website and LinkedIn, and the same for every employer on Referso Jobs.