Data Engineer
The Data Engineer builds and operates the pipelines that move data from source systems into the lakehouse and on to analytics and AI consumers, ensuring that the pipelines are automated, performant, secure and governed.
- Remote, United Arab Emirates
- Contract
- Remote
- Posted Nov 17, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics
Responsibilities
- Build batch, incremental, CDC and streaming ingestion pipelines from source systems into the Bronze layer, using Azure Data Factory and Fabric pipelines
- Develop Silver- and Gold-layer transformations in SQL, PySpark and Spark notebooks, including cleansing, conformance, enrichment and business-rule logic
- Implement dimensional models, SCDs, surrogate keys and data marts according to the architect's designs
- Integrate DQ checks, validation, quarantine and reconciliation into pipelines in partnership with the Senior Data Quality Engineer
- Ensure that pipelines publish metadata and lineage to Microsoft Purview
- Implement scheduling, dependency management, parameterization, error handling and alerting
- Optimize pipelines, partitioning, file formats (Delta/Parquet) and compute usage for performance and cost efficiency
- Apply access controls, masking, encryption and secure credential management in line with UAE PDPL, the Dubai Data Law and DESC ISR
- Maintain code in source control and deploy through CI/CD pipelines, with automated tests and environment promotion
- Support production operations, incident resolution and runbooks, and coach counterparts so that the pipelines can be sustained after handover
Requirements
- Experience in a UAE government
- Experience in a regulated-sector
Nice to have: Arabic proficiency
Skills
Advanced SQLPythonPySparkSparkAzure Data FactoryMicrosoft FabricDatabricksSynapseLakehouse/Medallion architectureDelta/Parquet formatsdimensional modellingSCDssurrogate keysCI/CDAzure DevOpsGitHubDataOps practicesMicrosoft PurviewUAE PDPLDubai Data LawDESC ISRAzure Data FactoryMicrosoft FabricDatabricksSynapseAzure DevOpsGitHubMicrosoft Purview
Full description
Company details are for members
Sign up for a free job alert to see Datamatics Technologies's profile, website and LinkedIn, and the same for every employer on Referso Jobs.