Databricks Workflows jobs

Director, Data & AI Platforms

Johnson & Johnson · Posted Nov 5, 2026

Open

Raritan, New Jersey, United States
Hybrid
Full-time · Manager
$168K–$291K per year
15+ years

Director, Data & AI Platforms

Johnson & Johnson · Posted Nov 5, 2026

Open

Raritan, New Jersey, United States
Hybrid
Full-time · Manager
$168K–$291K per year
15+ years

Senior Data Engineer

EY · Posted Nov 9, 2026

Open

Full-time · Senior
5+ years

Apply with RefersoAI Apply on careers page

Design, build, and optimize data pipelines using Databricks, PySpark, Python, and SQL; develop scalable ETL/ELT solutions and Lakehouse architectures; implement solutions using Delta Lake, Unity Catalog, Databricks Workflows, and Structured Streaming; develop and support Azure-based data platforms leveraging ADF and ADLS Gen2; optimize Spark workloads for performance, scalability, and cost efficiency; implement CI/CD, DataOps, and engineering best practices; collaborate with business and technical stakeholders to deliver high-quality data solutions; support data governance, quality, and security initiatives; mentor junior engineers and contribute to capability development.

Responsibilities

Design, build, and optimize data pipelines using Databricks, PySpark, Python, and SQL.
Develop scalable ETL/ELT solutions and Lakehouse architectures.
Implement solutions using Delta Lake, Unity Catalog, Databricks Workflows, and Structured Streaming.
Develop and support Azure-based data platforms leveraging ADF and ADLS Gen2.
Optimize Spark workloads for performance, scalability, and cost efficiency.

Requirements

Nice to have: Databricks Certified Data Engineer Associate
Nice to have: Microsoft Azure Data Engineer Associate (DP-203)
Nice to have: Microsoft Fabric
Nice to have: Snowflake
Nice to have: AWS

Skills

Databricks Azure Python

Principal Data Engineer

GSK · Posted Nov 9, 2026

Open

Bengaluru, Karnataka, India
Principal
5+ years

Apply with RefersoAI Apply on careers page

Lead key activities to progress the data foundation by building and maintaining scalable data pipelines, creating data products for AI and analytics, and ensuring data accuracy and trust.

Responsibilities

Design, build, and run scalable, production-grade data pipelines that collect, clean, transform, and deliver data.
Build reusable datasets, feature tables, and retrieval infrastructure (vector databases) for dashboards, models, and AI applications.
Define clear data contracts for consistent, quality-checked inputs.
Implement data quality checks, validation rules, monitoring, and alerting.
Track data lineage for audit readiness.

Requirements

Nice to have: LLM-based automation
Nice to have: AI agents
Nice to have: Databricks Genie

Skills

SQL Python PySpark Azure Databricks Delta tables Unity Catalog Databricks Workflows

Lead - Data Engineering

Syngene International Limited · Posted Nov 2, 2026

Open

Remote, India
Remote
3–5 years

Apply with RefersoAI Apply on careers page

Lead the data engineering team to support, maintain, and enhance PDS data products and ETL pipelines.

Responsibilities

Support, maintain, and enhance PDS data products, ETL pipelines built using DBT, AWS Glue, Databricks, and other cloud‑native technologies.
Analyze, troubleshoot, and resolve production incidents, ensuring high availability, reliability, and adherence to SLAs.
Develop pipeline enhancements, bug fixes, and operational automation to improve platform performance, scalability, and operational efficiency.
Ensure data quality, integrity, and operational stability through validation, monitoring, root cause analysis, and proactive issue resolution.
Collaborate with Analytics Engineering, Cloud Engineering, and Business teams to support feature releases, production deployments, and continuous improvements.

Requirements

Nice to have: data governance
Nice to have: access management
Nice to have: IAM
Nice to have: data security
Nice to have: compliance

Skills

AWS Glue Databricks DBT SQL

Systems Architect 2 - Cloud Data Engineer (Databricks)

U.S. Bank National Association · Posted Nov 3, 2026

Open

Cincinnati, Ohio, United States
$112K–$131K per year
7–9 years

Apply with RefersoAI Apply on careers page

Provides technical direction, guidance and support for architectural development that encompasses multiple technology disciplines, platforms and applications.

Compensation

Pay Range: $111,605.00 - $131,300.00

Responsibilities

Design and implement scalable Databricks Lakehouse architectures supporting enterprise data processing, analytics, and high-volume workloads.
Develop data solutions using Databricks, Python, PySpark, Databricks SQL, and Delta Lake.
Modernize and migrate complex Oracle SQL and PL/SQL workloads to Databricks and cloud-based data platforms.
Design and implement high-volume ETL/ELT pipelines, data ingestion, transformation, orchestration, and integration solutions.
Optimize Databricks performance, including SQL queries, data layouts, compute utilization, jobs, and distributed data processing.

Requirements

Bachelor's degree
Nice to have: financial or transactional data

Skills

Databricks Databricks Lakehouse Delta Lake Python

AI engineer-Databricks Data Platform

Ecolab · Posted Nov 6, 2026

Open

Bangalore, Karnataka, India
5+ years

Apply with RefersoAI Apply on careers page

Design, build, configure, and operationalize Databricks platform for enterprise Data & AI solutions.

Responsibilities

Design, build, configure, and maintain Databricks workspaces across development, testing, and production environments.
Implement platform standards, reusable frameworks, templates, and best practices.
Manage Unity Catalog, clusters, SQL Warehouses, compute policies, workspace configurations, and access controls.
Automate platform deployment and configuration using Infrastructure as Code (Terraform, CI/CD pipelines).
Build and integrate scalable data pipelines using Databricks Lakehouse architecture.

Requirements

Bachelor's or master’s degree in computer science, Engineering, IT, or a related field.
Nice to have: Generative AI
Nice to have: Agentic AI
Nice to have: LLM-based applications
Nice to have: Snowflake integration

Skills

Databricks Lakehouse Platform Delta Lake Unity Catalog MLflow Databricks Workflows

Data Engineer

Stoiximan · Posted Nov 6, 2026

Open

Athens, Attica, Greece +1 more
Hybrid
Full-time · Mid
3+ years

Apply with RefersoAI Apply on careers page

Build and maintain a lakehouse, develop ingestion pipelines, ensure data quality and governance, and support cloud cost and reliability.

Locations (2)

Athens, Attica, Greece
Thessaloniki, Central Macedonia, Greece

Compensation

Competitive pay & annual bonus

Responsibilities

Build and maintain our lakehouse following medallion standards
Deliver large, multi-source data projects from design to production
Develop reliable, idempotent ingestion pipelines (batch and streaming) from databases, APIs, and files
Build and maintain silver and gold pipelines for the BI team
Put security and governance in place: access control, masking, data classification, lineage, and metadata

Skills

Python PySpark

AI engineer-Databricks Data Platform

Ecolab Inc. · Posted Nov 6, 2026

Open

Bangalore, Karnataka, India
5+ years

Apply with RefersoAI Apply on careers page

Design, build, configure, and operationalize Databricks platform for enterprise Data & AI solutions.

Responsibilities

Design, build, configure, and maintain Databricks workspaces
Implement platform standards, reusable frameworks, templates
Manage Unity Catalog, clusters, SQL Warehouses, compute policies
Automate platform deployment using Terraform and CI/CD
Build scalable data pipelines with Databricks Lakehouse

Requirements

Bachelor's or master’s degree in computer science, Engineering, IT, or a related field
Nice to have: Generative AI
Nice to have: Agentic AI
Nice to have: LLM-based applications
Nice to have: Databricks integration with Snowflake

Skills

Databricks Lakehouse Platform Delta Lake Unity Catalog MLflow Databricks Workflows Structured Streaming

GDS Consulting_Senior Data Engineer

EY · Posted Nov 6, 2026

Open

Taguig, Metro Manila, Philippines
Senior
5+ years

Apply with RefersoAI Apply on careers page

EY GDS is seeking a Senior Data Engineer with strong expertise in Databricks, Azure, Python, and SQL to deliver enterprise-scale data modernization and cloud transformation programs, building modern Lakehouse solutions.

Responsibilities

Design, build, and optimize data pipelines using Databricks, PySpark, Python, and SQL.
Develop scalable ETL/ELT solutions and Lakehouse architectures.
Implement solutions using Delta Lake, Unity Catalog, Databricks Workflows, and Structured Streaming.
Develop and support Azure-based data platforms leveraging ADF and ADLS Gen2.
Optimize Spark workloads for performance, scalability, and cost efficiency.

Requirements

Nice to have: Databricks Certified Data Engineer Associate or Professional
Nice to have: Microsoft Azure Data Engineer Associate (DP-203)
Nice to have: Microsoft Fabric
Nice to have: Snowflake
Nice to have: AWS

Skills

Databricks Python SQL PySpark Delta Lake Unity Catalog

Data Engineer, Clinical Operations

Bristol Myers Squibb · Posted Nov 5, 2026

Open

Princeton, New Jersey, United States
Full-time · Entry
$66K–$79K per year
0–2 years

Apply with RefersoAI Apply on careers page

Support the broader Data Engineering community to deliver cutting‑edge data and analytics platforms for Global Drug Development, focusing on Cross Study Operations and Specimen Management.

Compensation

Princeton - NJ - US: $65,540 - $79,413

Responsibilities

Collaborate with BI&T partners, cross‑study operations leads, specimen management specialists, clinical study teams, and cross‑functional leaders to support effective adoption of our Data Platform
Design, build, and maintain scalable, production‑grade data pipelines and platform components for Cross Study Operations and Specimen Management
Develop and enhance data solutions to accelerate data usage across cross‑study clinical R&D programs
Optimize data platform components for performance, scalability, interoperability, availability, and cost‑effectiveness
Help design and build scalable ETL/ELT pipelines and data models using Databricks, Delta Lake, cloud‑native tools, semantic modeling, and interoperability standards

Skills

Databricks Delta Lake Unity Catalog Databricks Workflows Mosaic AI

Databricks Workflows jobs

Compensation

Responsibilities

Requirements

Skills

Benefits

Responsibilities

Requirements

Skills

Responsibilities

Requirements

Skills

Responsibilities

Requirements

Skills

Compensation

Responsibilities

Requirements

Skills

Responsibilities

Requirements

Skills

Locations (2)

Compensation

Responsibilities

Skills

Responsibilities

Requirements

Skills

Responsibilities

Requirements

Skills

Compensation

Responsibilities

Skills

Benefits

Benefits

Benefits

Benefits