Design and implement business-critical features and contribute to optimizing the performance of models on AWS Trainium end to end, focusing on LLM model families like GLM and Kimi.
USA, CA, Cupertino - 127,100.00 - 185,000.00 USD annually
- Optimize open models to run best on Trainium, including optimizing sharding, developing NKI kernels and ensuring accuracy.
- Collaborate with cross-disciplinary teams that may include hardware design, firmware, compiler, runtime, and ML engineers to develop software that enables and optimizes custom ML accelerator silicon.
- Write clean, maintainable code (C/C++, Python, or Rust) following best practices for systems-level and performance-critical development.
- Participate in code reviews, contribute to technical documentation, and help deploy agentic tools to accelerate the enablement of new models on Trainium.
- Demonstrate operational excellence through monitoring, debugging, and resolving issues across hardware-software integration boundaries, including on-call responsibilities.
- Bachelor's degree or above in Computer Science, Computer Engineering, Electrical Engineering, or related fields
- Nice to have: Compiler design or optimization
- Nice to have: Computer architecture
- Nice to have: Hardware simulation or emulation
- Nice to have: PyTorch
Post-Silicon Systems Validation Engineer I, Annapurna LabsAmazon · Austin, US