DATA ENGINEER
Data Engineer responsible for migrating Hadoop infrastructure to cloud, implementing data pipelines, and ensuring data quality.
- Madrid, Madrid, Spain
- Hybrid
- Posted Nov 11, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Migrate existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service
- Implement data transformation and quality to ensure data consistency and accuracy
- Utilize programming languages such as Scala and SQL and tools like Spark for data transformation and enrichment operations
- Set up CI/CD pipelines to automate deployments, unit testing and development management
- Write and conduct unit and validation tests to ensure accuracy and integrity of code developed
- Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly)
- Writing technical documentation (specifications, operational documents) to ensure knowledge capitalization
- Collaborate with cross-functional teams to understand data requirements and deliver solutions
- Foster a culture of continuous learning and improvement within the team
Requirements
- Experience in a banking industry
Skills
Spark on ScalaCI/CD tools (Gitlab, Jenkins…)HDFSstructured databases (SQL)Apache AirflowS3 storage/COS and parquet (and ORC) formatStrong knowledge of SQL and NoSQL databasesHadoopOozieShell scriptSoftware Development Lifecycle (SDLC) awarenessAgile principles and ceremoniesKubernetes containerizationDremioElasticsearchKibanaKafkaevent streamHVaultScalaSQLSparkGitlabJenkinsAirflowCOSParquetORCKubernetesDremioElasticsearchKibanaKafka
Full description
Company details are for members
Sign up for a free job alert to see Inetum's profile, website and LinkedIn, and the same for every employer on Referso Jobs.