- Shanghai, China
- Senior
- CN¥341K–CN¥1M per year
Design and evolve a large-scale offline ML platform, building reliable infrastructure for training datasets, orchestrating ML workflows, and enabling efficient, distributed model training at scale.
Compensation
Base Salary Range: CNY ¥341,000- ¥1,247,000 gross
Responsibilities
- Design and operate large-scale data pipelines that generate training datasets used for machine learning training and experimentation
- Develop infrastructure that supports distributed training workflows using technologies such as Pytorch, Ray Data, and Ray Train
- Integrate ML pipelines with workflow orchestration systems (e.g., Flyte, Airflow, or similar) to enable reliable multi-stage training workflows
- Improve reproducibility and observability of ML pipelines through dataset validation, monitoring, and automated testing
- Optimize performance and resource utilization across distributed compute systems used for data processing and model training