Databricks Structured Streaming jobs

Vice President, Data Ingestion & Integration

Ares Management Corporation · Posted Nov 11, 2026

Open

New York, New York, United States
On-site
Full-time · Vp
$210K–$230K per year

Vice President, Data Ingestion & Integration

Ares Management Corporation · Posted Nov 11, 2026

Open

New York, New York, United States
On-site
Full-time · Vp
$210K–$230K per year

Associate, Data Platform Engineering

Ares Management Corporation · Posted Nov 11, 2026

Open

New York, New York, United States
Full-time · Associate
$85K–$100K per year
6+ years

Apply with RefersoAI Apply on careers page

Associate, Data Platform Engineering

Compensation

$85,000 - $100,000

Responsibilities

Develop and maintain scalable data pipelines, ETL/ELT processes, and data integrations.
Support ingestion of structured and unstructured data from internal and external sources.
Assist with building and optimizing cloud-based data solutions and enterprise data platforms.
Partner with business teams to understand reporting and analytics requirements.
Monitor data quality, performance, and reliability across data environments.

Requirements

Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field
Nice to have: Financial Services
Nice to have: Asset Management
Nice to have: Banking
Nice to have: regulated industry experience

Skills

Azure Databricks Apache Spark Delta Lake Python SQL

Sr. Principal Architect-Data

Lilly · Posted Nov 11, 2026

Open

Hyderabad, Telangana, India
Principal
10+ years

Apply with RefersoAI Apply on careers page

Lead the end‑to‑end technical strategy and architecture of Lilly’s AI data platform on Databricks, designing autonomous multi‑agent AI workflows and governing AI assets across the enterprise.

Responsibilities

Own the Databricks Lakehouse architecture end‑to‑end
Design agentic AI systems and orchestration frameworks
Define Unity Catalog standards for AI assets
Architect real‑time and near‑real‑time agentic pipelines
Lead architectural decision records and platform blueprints

Requirements

Bachelor's degree in Computer Science, Data Engineering, Artificial Intelligence, or equivalent
Nice to have: Databricks Certified Data Engineer (Professional)
Nice to have: Databricks Certified Machine Learning Professional
Nice to have: Mosaic AI
Nice to have: Databricks Apps

Skills

Databricks Unity Catalog Delta Lake Databricks Structured Streaming Delta Live Tables Databricks Model Serving

Associate, Data Platform Engineering

Ares Management Corporation · Posted Nov 9, 2026

Open

New York, New York, United States
Full-time · Associate
$85K–$100K per year
6+ years

Apply with RefersoAI Apply on careers page

Support and operate the enterprise Azure and Databricks data platform, building scalable, secure, and reliable data pipelines and solutions.

Compensation

$85,000 - $100,000

Responsibilities

Develop and maintain scalable data pipelines, ETL/ELT processes, and data integrations.
Support ingestion of structured and unstructured data from internal and external sources.
Assist with building and optimizing cloud-based data solutions and enterprise data platforms.
Partner with business teams to understand reporting and analytics requirements.
Monitor data quality, performance, and reliability across data environments.

Requirements

Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field
Nice to have: Financial Services
Nice to have: Asset Management
Nice to have: Banking
Nice to have: Regulated Industry Experience

Skills

Azure Databricks Apache Spark Delta Lake Python

Vice President, Data Ingestion & Integration

Vice President, Data Ingestion & Integration

Compensation

Responsibilities

Requirements

Skills

Benefits

Associate, Data Platform Engineering

Compensation

Responsibilities

Requirements

Skills

Sr. Principal Architect-Data

Responsibilities

Requirements

Skills

Associate, Data Platform Engineering

Compensation

Responsibilities

Requirements

Skills

Benefits

Benefits