Design, build, and maintain data pipelines and data engineering solutions using Databricks, Apache Spark, Python, and Structured Query Language (SQL).
Compensation
A reasonable estimate of the current range is $ 86700 to $ 170900.
Responsibilities
Design, build, and maintain data pipelines and data engineering solutions using Databricks, Apache Spark, Python, and Structured Query Language (SQL)
Support the modernization of enterprise data platforms by implementing cloud-based ingestion, transformation, and storage patterns
Develop and maintain batch and streaming data workflows that support reporting, analytics, and artificial intelligence use cases
Apply data architecture, integration, and data modeling practices to improve data quality, scalability, and platform performance
Collaborate with client and Deloitte teams to troubleshoot issues, implement enhancements, and support delivery of large-scale data transformation programs
Requirements
Bachelor’s degree in Computer Science, Engineering, Information Systems, Data Science, Mathematics, or Statistics
The Sr. Staff Platform / Data Reliability Engineer is responsible for making Databricks a reliable, secure, scalable, and operationally mature platform for enterprise use, focusing on the platform layer including reliability, observability, deployment standards, and platform enablement patterns.
Compensation
Pay within range listed + Bonus + Benefits + Equity
Responsibilities
Own operational excellence for the Databricks platform, including monitoring, alerting, observability, incident response support, and production runbook patterns for data jobs and platform services.
Define and maintain CI/CD and promotion standards for Databricks assets, including workflows, jobs, notebooks, code packages, infrastructure configuration, and environment promotion from dev to prod.
Design and maintain platform standards for job orchestration, cluster and compute policies, service principal usage, environment isolation, and production execution reliability.
Establish reusable operational templates and enablement patterns for new domains onboarding to Databricks, including logging conventions, job tagging, metadata capture, and support handoff expectations.
Partner with the Senior Data Engineer to ensure ingestion and medallion patterns are implemented in a way that is observable, recoverable, cost-aware, and secure in production.