- Bellevue, Washington, United States +1 more
- Staff
- 10+ years
Lead technical design and implementation of Spark query compilation and runtime integration, owning complex engineering initiatives and providing technical leadership for production compiler and runtime capabilities.
Locations (2)
- Bellevue, Washington, United States
- Menlo Park, California, United States
Responsibilities
- Lead the technical design and implementation of Spark query compilation and runtime integration, including intermediate representations, type resolution, semantic compatibility, query-plan transformations, and efficient SQL generation.
- Own complex engineering initiatives from problem definition and architecture through implementation, validation, and production rollout.
- Provide technical leadership to project teams by clarifying engineering trade-offs, aligning contributors, reviewing designs and code, and resolving technical blockers.
- Improve end-to-end workload performance and cost-efficiency through profiling, compilation-latency reduction, metadata-access improvements, and collaboration with query-engine teams.