Senior Data Engineer | Real-Time & Streaming
A hands-on role to design, build, and operate real-time data products on an enterprise data platform, taking ownership from event ingestion and stream processing to the APIs used by consumers.
- Porto, Porto District, Portugal
- Hybrid
- Posted Nov 9, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Design and deliver end-to-end streaming data products using Apache Flink, Apache Kafka, and event-driven architectures.
- Develop stateful stream-processing applications, including windowing, event-time handling, watermarks, checkpointing, and exactly-once processing guarantees.
- Build and maintain resilient ingestion, transformation, and delivery pipelines for real-time and batch workloads.
- Manage Kafka topics, partitioning, consumer groups, schemas, and schema evolution.
- Design and develop REST APIs, streaming interfaces, and microservices with clear contracts, versioning, authentication, and rate limiting.
- Deploy and operate services on AWS, using Infrastructure as Code with Terraform.
- Embed data quality controls, automated testing, observability, and actionable alerting throughout the delivery lifecycle.
- Build and improve CI/CD pipelines, including automated deployment, rollback, and safe release practices.
- Monitor production services against agreed SLAs, investigate incidents, and optimise latency, throughput, reliability, and cost.
- Apply security best practices across authentication, authorisation, encryption, secrets management, and least-privilege access.
- Translate business requirements into technical designs, challenge assumptions, and propose practical solutions.
- Review code and designs, mentor engineers, and contribute to engineering standards and technical documentation.
Requirements
- Experience in a financial markets
- Experience in a streaming systems
Skills
Apache FlinkApache KafkaJavaPythonPyFlinkScalaAvroSchema RegistryRESTOpenAPIAWSTerraformSQLdata modellingCI/CDGitLab CIGitHub ActionsCloudWatchOpenTelemetryPrometheusGrafanaApache FlinkApache KafkaAWSMSKKinesisLambdaAPI GatewayECS/EKSS3IAMTerraformGitLab CIGitHub Actions
Full description
Company details are for members
Sign up for a free job alert to see Alongside's profile, website and LinkedIn, and the same for every employer on Referso Jobs.