- San Francisco
- $300K–$400K per year
Lead the design and execution of data pipelines and experiments for pretraining large AI models.
Compensation
We offer a base salary of $300,000–$400,000 USD and a meaningful equity grant, depending on experience and background, along with competitive benefits.
Responsibilities
- Build data pipelines for pretraining, including repository-scale code and technical documents
- Extract, filter, and deduplicate public data such as web pages, open-source code, and public datasets
- Decide data mixtures for each run and design ablations and scaling experiments
- Direct agents to run experiments and pipelines in parallel and evaluate results
- Extend code-first mixtures into scientific domains