Lead Data Engineer role focused on driving the modernization of a large-scale reconciliation data platform from legacy Hadoop to Databricks on AWS using Scala Spark and cloud-native patterns.
Responsibilities
Build and optimise large-scale Scala Spark data pipelines on Databricks, focusing on the reconciliation domain — writing clean, modular, and production-ready code
Drive modernisation efforts by refactoring legacy Hadoop-based pipelines into cloud-native Databricks/AWS architectures using Delta Lake and Databricks Workflows
Tune and simplify complex or over-engineered Spark jobs — analysing performance bottlenecks and transforming them into efficient, standardised patterns
Translate designs into reality — take high-level architectural decisions and convert them into detailed technical implementations, data models, and reusable pipeline components
Collaborate daily with architects, platform, and DevOps teams on design discussions, technical decisions, and production releases
Develop and lead the group-wide Data & AI platform strategy for Orca Group, creating the technological foundation for next-generation products with a focus on AI and agent-based functions.
Locations (2)
München, Bavaria, Germany
Rosenheim, Bavaria, Germany
Responsibilities
Entwickle und verantworte die gruppenweite Data- & AI-Platform-Strategie und priorisiere gemeinsam mit Product und Engineering die relevanten Daten, Use Cases und Plattform-Capabilities.
Baue eine gemeinsame, skalierbare Datenplattform mit Datenpipelines, gemeinsamen Domain-Modellen und messbarer Datenqualität über unsere Produkte hinweg auf.
Entwickle unsere Datenbasis für AI Agents weiter und ermögliche einen sicheren, berechtigungsgesteuerten Zugriff über moderne Retrieval-, Search- und Context-Lösungen.
Gestalte offene APIs und agentenfähige Schnittstellen, über die unsere Produkte, Partner und Kunden sicher mit unseren Daten und Plattform-Services arbeiten können.
Baue gemeinsame AI-Platform-Services für unsere Product Teams auf – von Retrieval und Evaluation über Model Routing und Guardrails bis zu Monitoring und Observability.
Lead engineering teams effectively, fostering a collaborative and high-performance culture to achieve project goals and meet organizational objectives.
Oversee timelines, team allocation, risk management and task prioritization to ensure the successful delivery of solutions within scope, time, and budget.
Mentor and support team members' professional growth, conduct performance reviews, provide actionable feedback, and identify opportunities for improvement.
Evaluation and enhancement of engineering processes, tools, and methodologies to increase efficiency, streamline workflows, and optimize team productivity.
Collaboration with business partners, product managers, designers, and other stakeholders to translate business requirements into technical solutions and ensure a cohesive approach to product development.
Senior builder who turns AI and data into production-ready products, designing architecture, writing code across frontend, backend, and data, and working closely with clients.
Locations (2)
Hellerup, Capital Region, Denmark
Copenhagen, Capital Region, Denmark
Responsibilities
Take client ideas from hypothesis to prototype and production system
Design architecture and write code across frontend, backend, and data
Deploy solutions in the cloud and set up observability
Review code and mentor less experienced engineers
Explain technical choices to non-technical stakeholders
Requirements
Master's degree in Computer Science, Engineering, or related field
Demand Reporting Data Analyst to join Anglian Water's Strategic Asset Management team and shape consumption data reporting and usage across the business.
Locations (2)
Huntingdon, England, United Kingdom
Peterborough, England, United Kingdom
Compensation
Circa £34,231 (depending on Skills & Experience)
Responsibilities
Work proactively with stakeholders to understand their reporting and analysis needs
Keep stakeholders informed, agree clear expectations and manage the delivery of analytics products
Source relevant data using stakeholder network, data catalogues and data architecture models
Cleanse, combine and analyse datasets using SQL, Power BI and Excel
Lead and facilitate business analysis activities throughout the programme and project lifecycle, supporting stakeholder engagement, process improvement, solution development, change management and successful implementation.
We are seeking an experienced Senior Data Engineer (Microsoft Fabric) to join our Data & Analytics team and support a large-scale data modernisation programme. This strategic initiative focuses on migrating the organisation's analytics platform from Oracle to Microsoft Fabric.
Responsibilities
Design, develop, and deploy end-to-end data pipelines in Microsoft Fabric.
Leverage Change Data Capture (CDC) and Fabric Mirroring capabilities to enable real-time data replication and unified analytics.
Support the migration of semantic models and analytical workloads from Oracle to Microsoft Fabric.
Build, optimise, and maintain scalable data integration and transformation solutions using PySpark and SQL.
Develop and enhance metadata-driven ingestion and orchestration frameworks.
Requirements
Nice to have: Metadata-driven ingestion and orchestration frameworks
Financial AnalystNewUniversity of Alberta · Edmonton, Canada
Data & AI Platform Lead (m/w/d)NewOrca Group GmbH · München, Germany+1 more
Business Intelligence Analyst, FP&ANewOrderYOYO · Copenhagen, Denmark
Consumption Data AnalystNewAnglian Water · Huntingdon, United Kingdom+1 more
Database Engineer (PostgreSQL & BigQuery)NewNTT DATA Romania SA · Bucuresti, Romania
Business Analyst - Corporate IT - FTCNewSmartestEnergy · Ipswich, United Kingdom+1 more