DATA ENGINEER (Scala/Spark)
Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service, implementing data transformation and quality.
- Madrid, Community of Madrid, Spain
- Full-time
- Hybrid
- Posted Nov 17, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics
Responsibilities
- Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service
- Implement data transformation and quality to ensure data consistency and accuracy
- Set up CI/CD pipelines to automate deployments, unit testing and development management
- Write and conduct unit and validation tests to ensure accuracy and integrity of code developed
- Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly)
- Writing technical documentation (specifications, operational documents) to ensure knowledge capitalization
- Collaborate with cross-functional teams to understand data requirements and deliver solutions
- Foster a culture of continuous learning and improvement within the team
Requirements
- Experience in a banking industry
Nice to have: Kubernetes containerization, Dremio, Elasticsearch, Kibana, Kafka, event steam, HVault
Skills
Full description
Company details are for members
Sign up for a free job alert to see Inetum's profile, website and LinkedIn, and the same for every employer on Referso Jobs.