Cloud-native data services jobs

Lead Data Engineer

X, bigly labs · Posted Nov 6, 2026

Melrose Arch, South Africa
Hybrid
Full-time · Senior
8+ years

Apply with RefersoAI Apply on careers page

Lead the development and maintenance of a scalable and secure data platform using the Medallion Architecture to support analytics, data science, and AI workloads with high performance and reliability.

Responsibilities

Lead the development and maintenance of a scalable and secure data platform using the Medallion Architecture
Build robust, reusable, and modular data pipelines leveraging Python, SQL, Spark, and cloud-native services
Enable secure and governed inbound and outbound data sharing with external partners
Collaborate with data analysts, data scientists, AI engineers and data quality analysts
Ensure data integrity, privacy, and compliance by implementing automated data quality checks

Requirements

Bachelor's degree in Computer Science
Bachelor's degree in Data Engineering
Bachelor's degree in Information Systems
Nice to have: Machine Learning certification
Nice to have: AI certification

Skills

Python SQL Spark cloud-native data services Databricks

AI Solutions Engineer

AI Solutions Engineer

Responsibilities

Requirements

Skills

Benefits

Lead Data Engineer

Responsibilities

Requirements

Skills