A hands-on role to design, build, and operate real-time data products on an enterprise data platform, taking ownership from event ingestion and stream processing to the APIs used by consumers.
Responsibilities
Design and deliver end-to-end streaming data products using Apache Flink, Apache Kafka, and event-driven architectures.
Develop stateful stream-processing applications, including windowing, event-time handling, watermarks, checkpointing, and exactly-once processing guarantees.
Build and maintain resilient ingestion, transformation, and delivery pipelines for real-time and batch workloads.
Manage Kafka topics, partitioning, consumer groups, schemas, and schema evolution.
Design and develop REST APIs, streaming interfaces, and microservices with clear contracts, versioning, authentication, and rate limiting.
The Lead Java Engineer, Vice President, will provide hands‑on technical leadership for the Java microservices and integration workstreams supporting the strategic clearing platform.
Responsibilities
Lead the technical planning, design, development and delivery of assigned Java microservices and integration workstreams for the replacement clearing platform, remaining hands‑on in complex or critical implementation activities.
Shape interface and API designs across clearing, settlement and downstream systems, aligning service boundaries, integration patterns and dependencies with the agreed target‑state architecture.
Lead the development of Apache Kafka event‑driven solutions, including producers, consumers and streaming integrations, ensuring agreed processing, resilience and data integrity requirements are addressed.
Provide application‑level technical leadership for deployment and troubleshooting on OpenShift, working with platform and infrastructure teams to ensure containerised services are production‑ready.
Partner with Solution Architects and Technical Leads to evaluate design options, resolve complex technical issues and establish reusable engineering patterns within enterprise standards and governance.
Requirements
Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related discipline; Master's degree preferred.
Nice to have: Red Hat Certified Specialist in OpenShift Administration
Lead Architect for Event‑Driven Architecture, responsible for designing and evangelizing real‑time integration solutions and leading the Cloud Native & EDA practice.
Responsibilities
Define real‑time integration strategies and design Event Mesh architectures
Evangelize decoupling paradigms such as Event Sourcing, CQRS, and lead Event Storming workshops
Advise clients on solution choices (Kafka, Solace, Cloud native) based on business and geographic constraints
Design, audit, and optimize complex data streaming platforms with deep expertise in Apache Kafka and Confluent
Integrate other market standards (Solace PubSub+, Apache Pulsar, MQTT) and managed cloud services (AWS MSK, Google Pub/Sub)
Principal Data Engineer, Data Warehouse (TPL)Engelhart · London, United Kingdom