Machine Learning Compiler Engineer
Compiler engineer focused on machine learning compilers at Jane Street
- New York, New York, United States
- Posted Nov 3, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Shape development of the ML compiler stack
- Design and implement optimizations such as algebraic rewriting, materialize vs recompute tradeoffs, fusion, equality saturation, scheduling languages, loop-level optimization, autotuning
- Develop ML compiler frontends for graph capture, symbolic and dynamic shapes, control flow, automatic differentiation
- Program GPU kernels and architecture using Triton, cuTile, CuTeDSL, CUDA, and tensor cores
- Apply compiler concepts like static analysis, intermediate representations (SSA, CFGs), instruction selection
- Implement ML inference features such as CUDA Graphs, KV caching, batching
- Implement ML training parallelism techniques (Tensor/Sequence/Expert/Pipeline Parallelism, FSDP, NCCL, activation checkpointing)
- Debug and optimize GPU code with CUDA-GDB, Nsight Systems, Nsight Compute
- Explore formal methods including proof assistants and automated theorem provers
- Design programming languages and DSLs with embedded DSLs, staging, metaprogramming, type systems, functional programming
Skills
Machine Learning compilerPyTorchJaxTensorFlowInductorXLATVMTritonHelioncuTileCUDAGPU kernel programmingstatic analysisSSACFGinstruction selectionCUDA GraphsKV cachingbatchingFSDPNCCLactivation checkpointingCUDA-GDBNsight SystemsNsight Computeproof assistantsautomated theorem proversembedded DSLsstagingmetaprogrammingtype systemsfunctional programmingPyTorchJaxTensorFlowInductorXLATVMTritonHelioncuTileCUDANsight SystemsNsight Compute
More jobs nearby
Full description
Company details are for members
Sign up for a free job alert to see Jane Street's profile, website and LinkedIn, and the same for every employer on Referso Jobs.