Responsible for end‑side model deployment, optimization, and system integration across heterogeneous CPU/GPU/NPU environments, ensuring performance, latency, throughput, and stability balance.
Responsibilities
Deploy end‑side models across CPU/GPU/NPU platforms
Perform performance profiling and bottleneck analysis
Implement token routing, device‑cloud orchestration, and low‑latency multimodal inference
Apply quantization, speculative decoding, and on‑policy distillation techniques
Align with Agentic OS framework metrics and establish performance regression and stability monitoring
Requirements
Master’s degree in Artificial Intelligence, Computer Science, Electronic Information Technology or related field
Lead the technical direction and development of LLM and agentic AI systems for Rapid7’s security platform, driving architecture, model strategy, inference optimization, and cross‑functional collaboration.
Responsibilities
Define architecture and roadmap for LLM and agentic AI systems
Lead model strategy and fine‑tuning of frontier and open‑source models
Optimize LLM inference at scale
Establish evaluation gates for AI systems
Lead design reviews and resolve technical trade‑offs
Design, deploy, and operate machine learning training and inference workloads on Amazon Web Services infrastructure, integrating generative models into production pipelines and optimizing GPU utilization.
Locations (2)
Culver City, California, United States
New York, New York, United States
Compensation
USA, CA, Culver City - 143,700.00 - 194,400.00 USD annually
USA, NY, New York - 158,100.00 - 213,800.00 USD annually
Responsibilities
Design, deploy, and operate ML training and inference workloads on EKS
Integrate generative ML models into production inference pipelines
Build training and fine‑tuning pipelines on EKS and SageMaker
Improve GPU utilization, throughput, and latency on the inference fleet
Build automated evaluation pipelines and quality metrics
Requirements
Bachelor's degree in computer science or equivalent
Nice to have: full software development life cycle
Lead research at the intersection of industry-scale data and academic rigor in Document Understanding, designing AI-native agentic systems to unlock insights from billions of historical and genealogical records.
Responsibilities
Implement cutting‑edge AI solutions for key Document Understanding tasks such as OCR/HTR, transcription, NER, Relation Extraction, Coreference Resolution, Summarization, and Knowledge Graphs
Design and implement multi‑agent workflows using frameworks like LangChain, LangGraph, CrewAI, AutoGen, AgentCore, Strands, Google ADK, A2A
Evaluate performance of multi‑modal AI & LLMs such as GPT, Gemini, Claude, Llama, and Qwen for zero‑shot and few‑shot scenarios
Apply expertise in computer vision models like YOLO, Nougat, DONUT, OpenCV for layout analysis
Establish ensemble models and LLM‑as‑a‑Judge frameworks, using tools like Arize Phoenix, DeepEval, or RAGAS
Requirements
Ph.D. in Computer Science, Data Science, Statistics, Linguistics, Engineering, or a related quantitative field
Research Engineer to make generative models dramatically faster, smaller and cheaper to run on-device and on server, working across the whole efficiency stack.
Locations (2)
Cupertino, California, United States
Seattle, Washington, United States
Responsibilities
Develop and deploy optimizations algorithms to speed up inference of production diffusion models (PTQ, QAT, kernel fusion, model distillation)
Design hardware-aware architectures that fit within compute and memory limits with minimal loss of quality
Own the process end-to-end from prototyping, evaluation to deployment into the Apple ecosystem
Requirements
M.S. or PhD in Computer Science or a related field such as Electrical Engineering, Robotics, Statistics, Applied Mathematics
Designs, builds, and operates secure, scalable AI systems focusing on Retrieval-Augmented Generation pipelines, agentic AI, and enterprise-grade service delivery across Azure and AWS.
Responsibilities
Architect and implement AI solutions
Integrate and operate AI infrastructure
Develop and manage data pipelines
Build agentic AI solutions
Model evaluation and optimization
Requirements
Bachelor’s degree in Computer Science, Engineering, Information Technology, Data Science
Nice to have: Microsoft Certified: Azure AI Engineer Associate
Nice to have: Microsoft Certified: Azure Data Scientist Associate
Nice to have: Microsoft Certified: Azure Solutions Architect Expert
Nice to have: Microsoft Certified: Azure Developer Associate
health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)