- San Jose, California, United States
- On-site
- Full-time
- $150K–$350K per year
ML Systems Engineer focused on optimizing large language model inference for an agentic AI platform used by semiconductor companies.
Compensation
$150K/yr – $350K/yr + Offers Equity
Responsibilities
- Design, deploy, and optimize LLM inference systems across multi-node clusters
- Implement and benchmark concrete inference optimizations
- Profile and analyze inference bottlenecks at the systems level
- Build robust evaluation harnesses and benchmarking frameworks
- Collaborate with research scientists to integrate new model architectures
Requirements
- B.S., M.S., or PhD in Computer Science, Electrical Engineering, or a related field (or equivalent experience)