Principal AI Engineers will define and influence the technical direction of LLM and agentic AI systems, building cutting-edge greenfield solutions to shape the next generation of AI at Rapid7.
Compensation
The annual salary range for this role, depending on location, is: United States: $221,000.00 - 299,000.00 USD Annual
Responsibilities
Define the architecture and technical roadmap for LLM and agentic AI systems across Detection and Response and Exposure and Remediation
Lead model strategy: when to use frontier or open-source models, and when to fine-tune, distill, or post-train
Fine-tune, distill and post-train open-source LLMs on security data, from data curation through training, evaluation and deployment
Set engineering standards for context engineering, inference optimization, and evaluation across teams
Optimize LLM inference at scale with techniques such as speculative decoding, KV-cache management, continuous batching, quantization and custom kernels
Requirements
PhD in Computer Science, Machine Learning, AI or a related field (preferred)
Nice to have: Experience pre-training or training LLMs from scratch
Nice to have: Experience writing GPU kernels (CUDA or Triton)
Nice to have: Security domain experience (detection engineering, SOC/MDR, or vulnerability management)
Nice to have: Experience running AI workloads on AWS at scale
Own platform strategy, priorities and roadmap across multiple teams for the Acclaim AI platform.
Responsibilities
Own platform strategy, priorities and roadmap across multiple teams
Turn competing requests into a ranked plan with clear goals that an executive can read once and understand
Align stakeholders from different departments on trade-offs, and keep the teams focused on right priorities
Run several teams or product areas, and step in hands-on where needed
Define and track platform metrics like business results, reliability and quality (SLA), time to deploy a new agent, and the delivery effort needed per client
Embeds with a strategic customer, an investment firm in New York. Owns the end-to-end deployment of AI-powered workflows, integrates systems, and turns field learnings into product direction.
Locations (2)
New York, New York, United States
Brooklyn, New York, United States
Responsibilities
Ship full-stack software and LLM or agent systems in production, including agents, retrieval and evals
Client-facing work with direct customer ownership from scoping through go-live, inside enterprises or financial institutions
Requirements
Nice to have: Fintech experience
Nice to have: PE software experience
Nice to have: Financial services consulting experience
Design and implement AI agents end-to-end, from the first idea to deployment and monitoring, balancing cutting-edge techniques with pragmatism to deliver measurable impact.
Compensation
Competitive compensation package
Responsibilities
Design and implement AI agents end-to-end, from the first idea to deployment and monitoring
Apply strong software engineering principles, such as modularity, testing, code reviews, CI/CD and observability, to ensure AI systems are reliable, maintainable, production-ready and can be readily adapted to future developments
Choose the right approach for the problem at hand, evaluating different models, prompts, tools and agent designs to balance trade-offs between speed, cost, complexity, interpretability, and performance
Collaborate closely with product, design, and other engineering teams to scope work, align on success metrics, and incrementally ship improvements in user-facing features powered by AI
Document system architectures and decision rationale early and clearly, enabling alignment across teams and accelerating onboarding and iteration
Requirements
Master's degree or above in Computer Science, Electrical Engineering or a related field
Design and implement AI agents end-to-end, from the first idea to deployment and monitoring, balancing cutting-edge techniques with pragmatism to deliver measurable impact.
Compensation
Competitive compensation package
Responsibilities
Design and implement AI agents end-to-end, from the first idea to deployment and monitoring, balancing cutting-edge techniques with pragmatism to deliver measurable impact.
Apply strong software engineering principles, such as modularity, testing, code reviews, CI/CD and observability, to ensure AI systems are reliable, maintainable, production-ready and can be readily adapted to future developments.
Choose the right approach for the problem at hand, evaluating different models, prompts, tools and agent designs to balance trade-offs between speed, cost, complexity, interpretability, and performance.
Collaborate closely with product, design, and other engineering teams to scope work, align on success metrics, and incrementally ship improvements in user-facing features powered by AI.
Document system architectures and decision rationale early and clearly, enabling alignment across teams and accelerating onboarding and iteration.
Requirements
Master's degree or above in Computer Science, Electrical Engineering or a related field
Design, build, and ship features end to end across our appraisal platform and AI-powered workflows, from data extraction and analysis to narrative generation.
Responsibilities
Design, build, and ship features end to end across our appraisal platform and AI-powered workflows, from data extraction and analysis to narrative generation
Work directly with appraisers and Ops to understand the problem, decide what to build, and make the product calls to get it shipped
Use AI coding tools (Claude Code, Codex, or similar) every day, and help shape how the team uses them well, including knowing where not to trust them
Build LLM-backed features with evaluation, testing, and monitoring in place so quality is measured, not guessed at
Own infrastructure and deployments on AWS, including CI/CD with GitHub Actions, infrastructure as code with Terraform, and containerized services with Docker
Rebuilding the software development lifecycle from first principles, building tools for the new bottlenecks and working modalities to reap the productivity gains of AI coding without compromising quality, scalability and reliability.
Locations (12)
Sunnyvale, California, United States
Washington, D.C., District of Columbia, United States
San Diego, California, United States
Ft. Walton Beach, Florida, United States
Ann Arbor, Michigan, United States
Staff Software Engineer - AI Developer Productivity
Rebuilding the software development lifecycle from first principles, building tools for the new bottlenecks and working modalities to reap the productivity gains of AI coding without compromising quality, scalability and reliability.
Locations (12)
Sunnyvale, California, United States
Washington, D.C., District of Columbia, United States
San Diego, California, United States
Ft. Walton Beach, Florida, United States
Ann Arbor, Michigan, United States
Lead/Staff Full Stack Engineer, AI Platform & Agents
Lead/Staff Full Stack Engineer, AI Platform & Agents
Responsibilities
Design and implement full‑stack applications, AI agents, and platform components that enable rapid GenAI agent development, validation, and deployment.
Build developer tooling, CI/CD, and observability for safe, fast iteration (evals, canaries, rollout/rollback, cost and quality telemetry).
Apply secure SDLC and privacy‑by‑design practices (threat modeling, least privilege).
Collaborate with product, UX, and domain experts to deliver customer‑focused solutions with measurable outcomes.
Apply current LLM patterns (RAG, retrieval, routing, tool‑use, evals) to deliver measurable customer value—faster, more reliable AI systems; reduced time‑to‑decision; improved trust/safety metrics; and lower cost per query.
Own the end-to-end architecture of the AI platform: gateway, agent runtime, MCP layer, skills and asset registry, retrieval, evals, observability, identity, and governance.
Compensation
160-180k + 25k Bonus + Stock Options (Based on experience and match to the role)
Responsibilities
Own the end-to-end architecture of the AI platform: gateway, agent runtime, MCP layer, skills and asset registry, retrieval, evals, observability, identity, and governance.
Design how agents run on Kubernetes: packaging, scheduling, scaling, isolation, networking, state and memory, versioning, promotion, and rollback.
Design the AWS foundation the platform sits on: EKS, IAM, networking, private endpoints, and infrastructure-as-code, built for a regulated enterprise with restricted egress.
Define the identity model for agents: how an agent authenticates as itself, acts on behalf of a user without gaining more access than that user has, and leaves an audit trail.
Define the developer experience: how a developer in the customer's organization goes from an idea to a deployed agent, with the right guardrails and the least friction.
Build and refine agent surfaces engineers use every day, including design and code review bots and tools, agentic production testing systems and coding agent harnesses
Design key building blocks for agents to be used across the company, such as permissioning systems, sandbox infrastructure, harness integrations and agent orchestration frameworks
Collaborate with all engineering teams to enable better code quality, testability and release processes
Carve out your own areas of expertise and influence product decisions - starting on day one
Establish best practices and standards to provide a well-lit-path for development
Requirements
Bachelor's degree in Computer Science, Software Engineering, or equivalent
Build and refine agent surfaces engineers use every day, including design and code review bots and tools, agentic production testing systems and coding agent harnesses
Design key building blocks for agents to be used across the company, such as permissioning systems, sandbox infrastructure, harness integrations and agent orchestration frameworks
Collaborate with all engineering teams to enable better code quality, testability and release processes
Carve out your own areas of expertise and influence product decisions - starting on day one
Establish best practices and standards to provide a well-lit-path for development
Requirements
Bachelor's degree in Computer Science, Software Engineering, or equivalent