Build and operate production-grade model-serving and inference systems supporting high-throughput, low-latency AI workloads.
Compensation
Competitive base pay for Bellevue market
Certain roles are eligible for additional rewards, including merit increases, annual bonus, and long term incentives.
Responsibilities
Build and operate production-grade model-serving and inference systems supporting high-throughput, low-latency AI workloads.
Optimize inference infrastructure for token throughput, latency, scalability, and cost efficiency across different model architectures and workloads.
Design systems that maximize GPU utilization while maintaining predictable performance and reliability.
Improve the scalability and operational maturity of inference platforms as customer demand grows.
Partner with AI training, GPU performance, orchestration, and infrastructure teams to ensure smooth transitions from model development to production serving.
Lead the design and development of our production inference platform and define the technical roadmap for inference infrastructure, model serving, and runtime optimization.
Compensation
Salary Range ($190- $230K) plus health insurance and equity. United States - Remote Pay Range $190,000—$230,000 USD
Responsibilities
Lead the design and development of our production inference platform
Define the technical roadmap for inference infrastructure, model serving, and runtime optimization
Build and operate scalable, cost-effective systems for serving large language models in production
Evaluate and integrate modern inference technologies, frameworks, and serving runtimes
Optimize latency, throughput, GPU utilization, memory efficiency, and infrastructure cost
Leads the Hospital Operations Center (HOC) teams and the organization to enhance patient access, capacity management, and throughput initiatives integrating the strategic and operations plan into operations.
Compensation
Base Pay Scale: Generally starting at $109.19 - $144.68 per hour. The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to, internal equity, experience, education and training.
Responsibilities
Leads Hospital Operations Team to develop and communicate patient flow strategies.
Translates strategic decisions into actionable steps for operations, including rollout, sustainment, and outcome reporting.
Develops strategic direction and partners with multidisciplinary teams to enhance compliance with patient status and admission/discharge protocols.
Identifies and initiates organizational strategies for enhancing patient flow and ensures cross-team functions are aligned.
Leads patient flow governance efforts including developing strategies and enhancing integration between various governance groups.
Provides enterprise leadership for system-wide patient access, placement, throughput, and load balancing across Texas Health Resources. Acts as the strategic and operational authority for the Capacity Command Center.
Responsibilities
Provide strategic oversight for infrastructure, processes, protocols and governance of the THR Capacity Command Center (24/7 operations).
Leads enterprise bed management strategy for admissions, discharges, transfers, ICU leveling, and specialty placement.
Establishes system load balancing methodologies across facilities.
Serves as enterprise escalation authority during surge, disaster, or operational disruption.
Activates tiered escalation protocols (Green/Yellow/Red/Black status). Partners with Incident Command when activated.
Design, develop, test, deploy, and support AI software components including foundation model training, large language model inference, agents and multi-agent workflows, similarity search, guardrails, model evaluation, experimentation, governance, and observability.
Locations (4)
Cambridge, Massachusetts, United States
McLean, Virginia, United States
New York, New York, United States
San Jose, California, United States
Compensation
Cambridge, MA: $197,300 - $225,100 for AI Engineer 4
McLean, VA: $197,300 - $225,100 for AI Engineer 4
New York, NY: $215,200 - $245,600 for AI Engineer 4
San Jose, CA: $215,200 - $245,600 for AI Engineer 4
Inference Engineer - Member of Technical StaffNewDesignworks Talent · Bellevue, US
Director Capacity Command OperationsTexas Health Resources · Arlington, US