Design, build, and deploy scalable and secure data engineering pipelines using Databricks on Azure, collaborating with clients and cross‑functional teams.
Locations (2)
Glasgow, Scotland, United Kingdom
Edinburgh, Scotland, United Kingdom
Responsibilities
Design and develop robust pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog
Build real‑time event‑driven solutions with Kafka and Azure Event Hubs
Apply DevOps principles to develop CI/CD pipelines using Azure DevOps, Jenkins, or GitHub Actions
Collaborate with clients and stakeholders to translate data needs into strategic technical solutions
Champion clean code, data lifecycle optimisation, and software engineering best practices
Design, build, and deploy scalable and secure data engineering pipelines using Databricks on Azure, collaborating with clients and stakeholders to translate data needs into strategic solutions.
Locations (2)
Glasgow, Scotland, United Kingdom
Edinburgh, Scotland, United Kingdom
Responsibilities
Design and develop robust pipelines using DeltaLake, Spark Structured Streaming, and Unity Catalog
Build real-time event-driven solutions with Kafka and Azure Event Hubs
Apply DevOps principles to develop CI/CD pipelines using Azure DevOps, Jenkins, or GitHub Actions
Collaborate with clients and stakeholders to translate data needs into strategic technical solutions
Champion clean code, data lifecycle optimisation, and software engineering best practices
