- Paris, Île-de-France, France +1 more
- Hybrid
- Full-time · Senior
Help own and evolve the formats and tokenizers that every part of the stack relies on, spanning pretraining, post-training, and deployment.
Locations (2)
- Paris, Île-de-France, France
- London, England, United Kingdom
Responsibilities
- Design, build and maintain core libraries for tokenization and model interfaces
- Evolve formats and tokenizers as models and use cases change
- Turn research needs into robust, shared tooling
Requirements
- Nice to have: tiktoken
- Nice to have: Hugging Face tokenizers
- Nice to have: Open-source maintenance
- Nice to have: Inference engines
