Structured Streaming jobs

Databricks Data Engineer

EXL · Posted Nov 5, 2026

Open

United States +1 more
Full-time
8–10 years

Apply with Referso

Databricks Data Engineer

EXL · Posted Nov 5, 2026

Open

United States +1 more
Full-time
8–10 years

Apply with Referso

Databricks Engineer

dataflix · Posted Nov 4, 2026

Open

Remote
Remote
Senior
7+ years

Apply with RefersoAI Apply on careers page

Responsibilities

Design and develop scalable data pipelines using Azure Databricks, Apache Spark, PySpark, Python, and Spark SQL.
Build and maintain Lakehouse architectures using Delta Lake, Delta Tables, Unity Catalog, and Medallion Architecture (Bronze/Silver/Gold).
Develop reusable batch and streaming ETL/ELT pipelines using Databricks Workflows, Lakeflow/Delta Live Tables, and Structured Streaming.
Optimize Spark workloads through partitioning, caching, query optimization, join/shuffle optimization, and performance tuning.
Develop complex SQL transformations, data models, schemas, and curated datasets for analytics and downstream applications.

Requirements

Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Science, or a related technical field.
Nice to have: ADLS Gen2
Nice to have: Azure Data Factory
Nice to have: Azure SQL
Nice to have: Azure data services

Skills

Azure Databricks PySpark Spark SQL Apache Spark

Lead Data Engineer / Data Product Lead – Snowflake

GTT, LLC · Posted Nov 4, 2026

Open

Toronto, Ontario, Canada
Hybrid
Contract
CA$60–CA$80 per hour

Apply with RefersoAI Apply on careers page

Lead Data Engineer / Data Product Lead – Snowflake

Compensation

Pay Rate: C$60.00–C$80.00 / Hour (CAD)

Responsibilities

Own one or more enterprise data products across architecture, design, development, testing, deployment, and ongoing enhancement.
Design and build scalable data solutions using Databricks, PySpark, Spark SQL, Delta Lake, and Python.
Contribute to architecture across data ingestion, transformation, medallion/lakehouse layers, semantic models, data quality, lineage, and downstream consumption.
Partner with Product Owners, architects, business stakeholders, analytics teams, and engineering leads to translate requirements into scalable technical solutions.
Design reusable and modular data models that support evolving reporting and analytical requirements.

Requirements

Nice to have: pharmaceutical
Nice to have: biotechnology
Nice to have: life sciences environments
Nice to have: commercial data
Nice to have: patient data

Skills

ETL/ELT data modeling lakehouse architecture

Data Engineer

Somerset Bridge Group · Posted Sep 4, 2026

Open

Newcastle, Tyyneside, United Kingdom
Hybrid
Full-time
£53K–£67K per year

Apply with RefersoAI Apply on careers page

Designing, building and optimizing scalable data solutions using Azure Databricks, Azure Data Factory, and Delta Lake to support wider business operations.

Compensation

£53,000 - £67,000 / year

Responsibilities

Design, build and maintain scalable data pipelines using Azure Databricks, Azure Data Factory and Delta Lake to support both real-time and batch data processing
Develop and optimise cloud-based data solutions within Azure, ensuring high performance, scalability, and cost efficiency
Create robust data models and lakehouse architectures to support analytics, reporting and machine learning initiatives
Automate and monitor data workflows using tools such as Databricks Workflows, Delta Live Tables and Azure Monitor
Ensure data quality, integrity, and governance through effective controls, security standards, and regulatory compliance

Requirements

Nice to have: Scala
Nice to have: MLOps
Nice to have: feature stores
Nice to have: machine learning platforms

Skills

Azure Data Factory Databricks Azure Data Lake

Data Engineer

Somerset Bridge Group · Posted Sep 4, 2026

Open

Bristol, Bristol, United Kingdom
Hybrid
Full-time · Mid
£53K–£67K per year

Apply with RefersoAI Apply on careers page

Designing, building and optimising scalable data solutions on a cloud-based Azure Databricks platform to support Pricing, Underwriting, Claims and wider business operations.

Compensation

£53,000 - £67,000 / year

Responsibilities

Design, build and maintain scalable data pipelines using Azure Databricks, Azure Data Factory and Delta Lake to support both real-time and batch data processing.
Develop and optimise cloud-based data solutions within Azure, ensuring high performance, scalability, and cost efficiency.
Create robust data models and lakehouse architectures to support analytics, reporting and machine learning initiatives.
Automate and monitor data workflows using tools such as Databricks Workflows, Delta Live Tables and Azure Monitor.
Ensure data quality, integrity, and governance through effective controls, security standards and regulatory compliance.

Requirements

Nice to have: Scala
Nice to have: MLOps
Nice to have: feature stores
Nice to have: machine learning platforms

Skills

Azure Data Factory Databricks Azure Data Lake

Senior Databricks Data Engineer

Q1 Technologies, Inc · Posted Nov 3, 2026

Open

New York, New York, United States
Senior
10+ years

Apply with RefersoAI Apply on careers page

Senior Databricks Data Engineer

Skills

Databricks PySpark Delta Lake Unity Catalog MLflow Kafka AWS PostgreSQL Java React Python KONG API gateway Auto Loader Structured Streaming CI/CD Power BI

Azure Databricks Engineer - Assistant Manager

State Street · Posted Oct 28, 2026

Open

Bangalore, Karnataka, India
6+ years

Apply with RefersoAI Apply on careers page

Design, develop, and support scalable data engineering solutions on Microsoft Azure using Azure Databricks, Apache Spark, Scala, Snowflake, and related technologies.

Responsibilities

Design and develop scalable, secure, and maintainable data-engineering solutions on Microsoft Azure
Build and support high-volume data-processing workloads using Azure Databricks, Apache Spark, and Scala
Develop reliable ETL/ELT pipelines for data ingestion, transformation, processing, and delivery
Design and implement Snowflake data-processing and data-warehouse solutions
Develop and optimize SQL queries, stored procedures, functions, and transformation logic

Requirements

Bachelor’s degree in computer science, Engineering, Information Technology, or a related discipline
Nice to have: Azure Data Factory (ADF)
Nice to have: Python
Nice to have: Azure SQL or Azure SQL Managed Instance
Nice to have: Oracle or SQL Server

Skills

Azure Databricks Apache Spark Scala Snowflake SQL

Databricks Data Engineer

Databricks Data Engineer

Locations (2)

Responsibilities

Requirements

Skills

Databricks Engineer

Responsibilities

Requirements

Skills

Lead Data Engineer / Data Product Lead – Snowflake

Compensation

Responsibilities

Requirements

Skills

Data Engineer

Compensation

Responsibilities

Requirements

Skills

Data Engineer

Compensation

Responsibilities

Requirements

Skills

Senior Databricks Data Engineer

Skills

Azure Databricks Engineer - Assistant Manager

Responsibilities

Requirements

Skills

Benefits

Benefits

Benefits