- Palo Alto, California, United States
- On-site
- Full-time
- $160K–$250K per year
- 3+ years
Software Engineer, Pretraining Data
Compensation
$160,000 - $250,000 USD
Responsibilities
- Build the platform that turns raw web, code, multimodal, and acquired data into training-ready datasets for frontier pretraining runs
- Own the pipelines, orchestration, and tooling that make pretraining data iteration fast, reliable, observable, and reproducible at scale
- Create clear signals for data quality, lineage, freshness, and pipeline health so researchers can trust what goes into each run
- Partner with initial training, crawling, data quality, and acquisition teams to turn new data ideas into measurable improvements in loss, evals, and model capability
- Build and own high-throughput, fully telemetered data pipelines that process frontier-scale data with end-to-end traceability
Requirements
- Nice to have: staff-level ownership
- Nice to have: AI agents
- Nice to have: large-scale distributed systems
- Nice to have: fast ownership
- Nice to have: debug complex systems