- Tampa
- 5+ years
Design, build, test, deploy, and support scalable data pipelines and data products on Azure Databricks.
Responsibilities
- Design, build, test, deploy, and support scalable data pipelines and data products on Azure Databricks.
- Develop ingestion and transformation processes for data from on-premises, cloud, SaaS, and third-party sources using batch and, where appropriate, streaming patterns.
- Use SQL and Python or PySpark to transform, validate, and optimize large and complex datasets.
- Design and maintain reusable data structures across raw, refined, and curated layers, applying dimensional modeling and star schema principles where appropriate.
- Build reliable Delta Lake solutions and apply Databricks capabilities for orchestration, performance, observability, and data quality.
Requirements
- Bachelor’s degree in technology, engineering, computer science, or a related field, or an equivalent combination of education and experience.
- Nice to have: semantic models
- Nice to have: business ontologies
- Nice to have: agentic AI patterns
- Nice to have: Model Context Protocol (MCP)