Databricks Data Engineer
- Mexico City, Distrito Federal, Mexico
- Posted Nov 13, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Design and implement end-to-end data pipelines using Azure Databricks including batch and streaming workflows
- Build and maintain Delta Lake architecture including bronze, silver, and gold layers
- Develop scalable ETL/ELT pipelines using Apache Spark (PySpark / Scala)
- Optimize Databricks jobs for performance, cost, and reliability — including cluster tuning, caching, and query optimization
- Implement Delta Live Tables (DLT) for declarative pipeline development
- Build and maintain Unity Catalog for data governance, lineage, and access control
- Collaborate with data architects to design data models (medallion architecture, star/snowflake schemas)
- Integrate Databricks with cloud services: Azure Data Factory, Azure Synapse, S3, ADLS Gen2
- Implement CI/CD pipelines for Databricks notebooks and jobs using Azure DevOps / GitHub Actions
- Ensure data quality, monitoring, and alerting across data pipelines
- Contribute to client workshops, technical design sessions, and solution architecture reviews
Requirements
Nice to have: Snowflake, IICS, Stonebranch, YAML
Skills
DatabricksPySparkScalaDelta LakeSQLPythonMicrosoft AzureApache AirflowAzure Data FactoryDatabricks WorkflowsGitCI/CDAgile/ScrumAzure DatabricksDelta LakeApache SparkAzure DevOpsGitHub ActionsAzure Data FactoryAzure SynapseS3ADLS Gen2Unity CatalogAzure Data FactoryApache Airflow
Full description
SGF Global Inc
Company details are for members
Sign up for a free job alert to see SGF Global Inc's profile, website and LinkedIn, and the same for every employer on Referso Jobs.