Build the engineering systems that help Bask Health test, evaluate, and improve AI-powered applications throughout their development and production lifecycles.
Responsibilities
Design, build, and maintain software infrastructure that supports AI quality and evaluation across Bask Health.
Develop backend services that execute and manage automated AI evaluations.
Build reusable testing tools for large language model applications.
Create APIs that allow engineering teams to submit evaluation jobs and retrieve results.
Develop systems for managing evaluation datasets, test cases, and expected outcomes.
Lead our pioneering AI initiative at AWS and define the future of AI agents. Shape how businesses leverage artificial intelligence by creating foundational building blocks used across AWS business applications.
Compensation
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually
Responsibilities
Own the technical architecture and strategy for a critical AI agent capability area, setting the foundation for enterprise-scale AI solutions across AWS
Lead projects requiring multiple engineers, balancing business goals with technical excellence while navigating ambiguous problem spaces
Research, evaluate, and integrate state-of-the-art AI technologies, making informed decisions about build vs. leverage approaches
Design and implement reusable AI components that meet enterprise-grade quality standards while simplifying complex technical challenges
Drive consensus across teams with different priorities and perspectives to create unified AI building blocks
Requirements
Bachelor's degree in computer science or equivalent
Nice to have: 10+ years of full software development life cycle
Nice to have: Bachelor's degree in computer science or equivalent
Nice to have: experience designing and implementing evaluation systems
health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
