Databricks Data Engineer
Experienced Databricks Data Engineer with strong expertise in Apache Spark, PySpark, Azure data engineering, and large-scale data pipeline development.
- Atlanta, Georgia, United States
- Full-time
- Posted Nov 16, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics
Responsibilities
- Design, develop, and support batch-based, distributed, and real-time data pipelines.
- Build highly available, fault-tolerant, self-healing, and adaptive data processing solutions.
- Develop scalable data engineering solutions using Apache Spark and PySpark.
- Implement data ingestion patterns and pipelines within Azure environments.
- Design and manage workflow orchestration using Azure Data Factory (ADF) or Apache Airflow.
- Optimize queries processing billions of rows across distributed query engines.
- Perform root cause analysis and implement permanent solutions for technical and business process issues.
- Provide technical consultation and lead the implementation of complex data engineering projects.
- Develop and maintain technical documentation for assigned systems and projects.
- Ensure data accuracy, reliability, scalability, and performance across data platforms.
Requirements
- Experience in a Big Data Systems
Nice to have: Jupyter Notebooks, Google Colab, Databricks
Skills
Apache SparkPySparkAzure Data EngineeringAzure Data FactoryApache AirflowSQLData ModelingDatabricksApache SparkPySparkAzure Data FactoryApache AirflowJupyter NotebooksGoogle Colab
More jobs nearby
Full description
Apolis
Company details are for members
Sign up for a free job alert to see Apolis's profile, website and LinkedIn, and the same for every employer on Referso Jobs.