Lead Data Engineer
X, bigly labs · Posted Nov 6, 2026
- Melrose Arch, South Africa
- Hybrid
- Full-time · Senior
- 8+ years
Lead the development and maintenance of a scalable and secure data platform using the Medallion Architecture to support analytics, data science, and AI workloads with high performance and reliability.
Responsibilities
- Lead the development and maintenance of a scalable and secure data platform using the Medallion Architecture
- Build robust, reusable, and modular data pipelines leveraging Python, SQL, Spark, and cloud-native services
- Enable secure and governed inbound and outbound data sharing with external partners
- Collaborate with data analysts, data scientists, AI engineers and data quality analysts
- Ensure data integrity, privacy, and compliance by implementing automated data quality checks
Requirements
- Bachelor's degree in Computer Science
- Bachelor's degree in Data Engineering
- Bachelor's degree in Information Systems
- Nice to have: Machine Learning certification
- Nice to have: AI certification