Back to search

Senior Data Engineering Tech Lead (Apache Flink/Kafka/AWS)

Lead real‑time data engineering projects, own streaming data products, set technical direction, mentor team, and ensure production quality.

  • Lisbon, Lisbon District, Portugal
  • Full-time
  • Hybrid
  • €3K–€3K per month
  • Posted Nov 17, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software

Responsibilities

  • Design and build streaming data products with Apache Flink, Apache Kafka and event‑driven patterns
  • Develop ingestion, processing, transformation and delivery pipelines for real‑time and batch workloads
  • Build REST/OpenAPI and streaming interfaces, plus microservices for data consumers
  • Work across AWS services: MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS, EKS, S3 and IAM
  • Define data quality controls, schema management, validation processes and automated tests
  • Implement CI/CD with GitLab CI, GitHub Actions or equivalent
  • Set up observability with CloudWatch, Prometheus, Grafana and OpenTelemetry
  • Support production services, resolve incidents, tune performance and run root‑cause analysis
  • Apply security practices: authentication, authorisation, encryption, secrets management and access control
  • Lead technical designs, code reviews, architecture discussions, documentation and knowledge sharing

Skills

Apache FlinkApache KafkaAWSMSKKinesisManaged Service for Apache FlinkLambdaAPI GatewayECSEKSS3IAMCI/CDGitLab CIGitHub ActionsCloudWatchPrometheusGrafanaOpenTelemetryobservabilitycloud securityproduction supportApache FlinkApache KafkaAWSMSKKinesisManaged Service for Apache FlinkLambdaAPI GatewayECSEKSS3IAMGitLab CIGitHub ActionsCloudWatchPrometheusGrafanaOpenTelemetry

Benefits

  • 15th month salary
  • Health insurance covering your family
  • Birthday off
  • Mobility program for digital nomads
  • Real work‑life balance

Full description

Senior Data Engineering Tech Lead (Apache Flink/Kafka/AWS) - Hybrid Lisbon (3 days/week office) ABOUT THE OPPORTUNITY We're looking for a Senior Tech Lead in real-time data engineering to own streaming data products from start to finish. You'll set the technical direction, make architecture decisions and mentor the team. You'll also stay hands-on with Apache Flink, Apache Kafka and AWS. This is a senior role with real influence over how real-time data is ingested, processed and delivered in production. PROJECT & CONTEXT You'll join a project building real-time and batch data products on an event-driven architecture. The scope covers the full lifecycle, from ingestion and stream processing to API delivery and production support. Your work will include: Designing and building streaming data products with Apache Flink, Apache Kafka and event-driven patterns Developing ingestion, processing, transformation and delivery pipelines for real-time and batch workloads Building REST/OpenAPI and streaming interfaces, plus microservices for data consumers Working across AWS services: MSK, Kinesis, Managed Service for Apache Flink, Lambda, API Gateway, ECS, EKS, S3 and IAM Defining data quality controls, schema management, validation processes and automated tests Implementing CI/CD with GitLab CI, GitHub Actions or equivalent Setting up observability with CloudWatch, Prometheus, Grafana and OpenTelemetry Supporting production services, resolving incidents, tuning performance and running root-cause analysis Applying security practices: authentication, authorisation, encryption, secrets management and access control Leading technical designs, code reviews, architecture discussions, documentation and knowledge sharing WHAT WE'RE LOOKING FOR (Required) 10+ years of experience in software engineering, data engineering or a related technical field Proven track record of delivering real-time data products in production Strong hands-on experience with Apache Flink and Apache Kafka Solid experience with streaming pipelines, event-driven systems, APIs, microservices and distributed systems Production experience with AWS data and application services Experience with data quality, schema governance, automated testing and CI/CD Knowledge of observability, cloud security and production support Experience leading technical discussions, reviewing code and mentoring engineers Fluent, bilingual-level English for daily work with international technical and business teams Based in Lisbon and available to work on-site 3 days per week Compensation: €2,500– €3,200/month net, depending on experience and seniority level. Why HumanIT people stay (4.4 Glassdoor, 89% recommend) - 15th month salary - Health insurance covering your family - Birthday off - Mobility program for digital nomads - Real work-life balance Full benefits https://www.humanit.pt/careers/#perks What it's really like https://www.humanit.pt/careers/#work-at

Senior Data Engineering Tech Lead (Apache Flink/Kafka/AWS) at HumanIT Digital Consulting | Referso Jobs