- Palo Alto, California, United States +1 more
- On-site
- Full-time · Staff
1–7 jobs· newest first

On-site · Full-time · Staff

On-site · Full-time · Staff

$200K–$350KOn-site · Full-time · Staff


Staff
Principal
$200K–$300KOn-site · Full-timeVisa
+10K new in the last hour
Founding members to build the systems that serve our frontier models at scale: the kernels, runtimes, batching, KV cache, load balancing, and scheduling that determine how quickly and cost-effectively each token is delivered across thousands of GPUs.
Highly competitive salary and equity
Founding engineer to own kernel-level performance across the inference stack, identifying bottlenecks, writing and fusing GPU kernels, and using agents to automate kernel optimization.
Highly competitive salary and equity
Founding members to lead frontier AI research projects and translate findings into production inference, spanning post-training, fine-tuning, quantization, speculative decoding, and optimization across kernels, serving systems, and models.
Highly competitive salary ($200,000–$350,000+) and equity
Lead cutting‑edge research on on‑device model and agent efficiency, focusing on compression, acceleration, and heterogeneous inference across CPU/GPU/NPU platforms.
Conduct cutting-edge research on on-device efficiency, focusing on compression and acceleration (FP4/INT4 QAT, speculative decoding, on-policy distillation), on-device Agent and token routing/device-cloud orchestration algorithms, and low-latency privacy-preserving personalized multimodal model structures and inference mechanisms.
Lead the technical direction and development of LLM and agentic AI systems for Rapid7’s security platform, driving architecture, model strategy, inference optimization, and cross‑functional collaboration.
True Talent Solutions Partners · Posted Nov 16, 2026
Ship support for new open-source models, tuning them for latency and throughput; optimize inference serving; write and tune kernels; design, deploy, and operate heterogeneous clusters; run production inference; work with customers to understand technical needs and solve infrastructure problems.
Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.