- New York, United States
- Full-time · Senior
- 10–12 years
Lead Databricks Data Engineer
Responsibilities
- Design and implement enterprise-scale data platforms using Databricks Lakehouse architecture.
- Architect and develop scalable ETL/ELT data pipelines for batch and real-time processing.
- Define enterprise data models, ingestion frameworks, and transformation strategies.
- Lead the implementation of Delta Lake, Unity Catalog, and data governance frameworks.
- Build and optimize highly scalable Spark and PySpark solutions handling large-volume datasets.
Requirements
- Bachelor's or Master's Degree in Computer Science, Engineering, Information Technology, or related field
- Nice to have: Scala (Preferred)
- Nice to have: MLOps and AI Engineering exposure
- Nice to have: Snowflake and Databricks integration experience
- Nice to have: Microsoft Fabric exposure