Back to search

Lead Databricks Engineer

Lead Databricks Engineer

  • New York, New York, United States
  • $55–$60 per hour
  • Posted Nov 10, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software

Responsibilities

  • Lead Databricks Lakehouse leadership
  • workspace administration
  • Delta Lake
  • PySpark
  • Unity Catalog
  • MLflow
  • AWS integration
  • CI/CD
  • performance optimization
  • governance and delivery coordination
  • Enterprise data architecture
  • data modeling
  • metadata management
  • security
  • integration and insurance data domains
  • Auto Loader
  • Structured Streaming
  • AWS S3 ingestion
  • workflow orchestration
  • performance tuning
  • production data pipelines

Skills

Databricks Lakehouse leadershipworkspace administrationDelta LakePySparkUnity CatalogMLflowAWS integrationCI/CDperformance optimizationgovernance and delivery coordinationEnterprise data architecturedata modelingmetadata managementsecurityintegration and insurance data domainsAuto LoaderStructured StreamingAWS S3 ingestionworkflow orchestrationperformance tuningproduction data pipelinesDatabricksPySparkSpark SQLDelta LakeAuto LoaderStructured StreamingAWS S3CI/CDMLflowUnity Catalog

More jobs nearby

Full description

Job Title: Lead Databricks Engineer Location: Local to New york NY only! Face to face interview Duration: 6 months (Extendable) Pay Range: $55-60/Hour on W2/C2C (All Inclusive) Request ID: 114974-1 Position Summary: Databricks Lakehouse leadership| workspace administration| Delta Lake| PySpark| Unity Catalog| MLflow| AWS integration| CI/CD| performance optimization| governance and delivery coordination.Enterprise data architecture| Databricks Lakehouse| Delta Lake| data modeling| Unity Catalog governance| AWS data services| metadata management| security| integration and insurance data domains.Databricks| PySpark| Spark SQL| Delta Lake| Auto Loader| Structured Streaming| AWS S3 ingestion| workflow orchestration| performance tuning| CI/CD and production data pipelines. Essential Skills: Databricks Lakehouse leadership| workspace administration| Delta Lake| PySpark| Unity Catalog| MLflow| AWS integration| CI/CD| performance optimization| governance and delivery coordination.Enterprise data architecture| Databricks Lakehouse| Delta Lake| data modeling| Unity Catalog governance| AWS data services| metadata management| security| integration and insurance data domains.Databricks| PySpark| Spark SQL| Delta Lake| Auto Loader| Structured Streaming| AWS S3 ingestion| workflow orchestration| performance tuning| CI/CD and production data pipelines. Desirable Skills: Keyword: Skills: Digital : Databricks Experience Required: 10 & Aboveed: 8-10

Lead Databricks Engineer at Artech LLC | Referso Jobs