Back to search

Data Engineer Master

Design, implementation and test of data pipelines with the goal of enabling business analysis, capable to implement near real-time scenarios, and development of Event-driven solution.

  • Rio Tinto, Portugal
  • Posted Jan 1, 2024
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareE-commerce

Responsibilities

  • Coordination with business side
  • Design, implementation and test of data pipelines with the goal of enabling business analysis
  • Capable to implement near real-time scenarios
  • Development of Event-driven solution

Requirements

  • bachelor's degree in software engineering
  • bachelor's degree in Computer Engineering
  • Experience in a retail
  • Experience in a e-commerce

Nice to have: Braze integration with Snowflake, Microsoft BI stack (SSIS/SSAS/SSRS) migration to Snowflake, Preparing datasets for data science / ML (RFM, churn, recommendation models), Snowflake or cloud data certifications

Skills

SQLPythonSnowflakeCustomer 360 / CDPETL/ELT pipelinesDimensional modelsCloud (Azure, AWS or GCP)Orchestration (Azure Data Factory, Airflow, dbt)GitSnowflakePythonSQLAzureAWSGCPAzure Data FactoryAirflowdbtGitBrazeSalesforce Marketing CloudAdobe CampaignSalesforceGA/GA4

Full description

Nome da função: Localização: Regime de trabalho: Vem fazer parte de um ecossistema dinâmico onde o futuro dos negócios é criado e vivido todos os dias. Faz parte desta transformação! Na LUZA Group, a paixão, a perseverança e a vontade de superar limites definem o nosso caminho para o sucesso. Fundada em 2006, somos uma multinacional portuguesa com mais de 1.200 profissionais talentosos e um volume de negócios que supera os 30M€. Com presença em mercados estratégicos como Portugal, Espanha, Marrocos, Brasil, México, Estados Unidos e China, oferecemos soluções inovadoras em engenharia, TI, design, consultoria, Indústria 4.0, formação e recrutamento. Tudo o que fazemos é movido pelo talento das nossas pessoas. Este é um momento de crescimento e oportunidade. O futuro pertence a mentes visionárias. Vais juntar-te a nós? Responsabilidades e Tarefas da Função Coordination with business side Design, implementation and test of data pipelines with the goal of enabling business analysis Capable to implement near real-time scenarios Development of Event-driven solution. Experience with POS systems. Requisitos Obrigatórios 8+ years working as a data engineer. 3+ years in a lead / senior role (owning design decisions, reviewing work of others). Strong experience with: Customer 360 / CDP or similar customer data platforms and Large-scale data pipelines on Snowflake (core requirement). Background in retail or ecommerce (online + store data is a plus). Experience moving data platforms from on-prem BI/DWH to cloud. Academic qualifications - bachelor's degree in software engineering, Computer Engineering, or a related field. Technical Skills: Data Engineering Very strong SQL (joins, window functions, query tuning) and strong knowledge in Python Design and build of ETL/ELT pipelines: Incremental loads using timestamps or change flags and error handling, restart / re-run without data issues. Good knowledge of data modelling: Dimensional models (facts and dimensions) and Customer data concepts: identities, events, sessions, behaviour. Snowflake Hands-on with: Warehouses, schemas, stages, file formats; tasks, streams, Time Travel, micro-partitions; roles, permissions and separation of environments (dev/test/prod). Used to improving performance and cost: query tuning and clustering and warehouse sizing and auto-suspend. Integration & Marketing Data Experience connecting data to MarTech / CDP tools (e.g. Braze, Salesforce Marketing Cloud, Adobe Campaign, etc.) and Ingesting data from: CRM / ecommerce platforms (e.g. Salesforce or similar), Web/app analytics tools (GA/GA4 or similar) and POS / store systems and customer support tools. Comfortable working with event data and near real-time feeds. Cloud, Orchestration & CI/CD Experience with at least one major cloud (Azure, AWS or GCP). Worked with orchestration tools (Azure Data Factory, Airflow, dbt, or similar). Git-based development (branches, pull requests, code review). Basic CI/CD for data pipelines (e.g. Azure DevOps, GitHub Actions). Data Quality & Monitoring Setting up data checks (completeness, duplicates, basic business rules). Monitoring jobs and data freshness, creating alerts when something fails. Requisitos Complementares Direct experience integrating Braze with Snowflake. Background with Microsoft BI stack (SSIS/SSAS/SSRS) and migrations to Snowflake. Experience preparing datasets for data science / ML (RFM, churn, recommendation models). Certifications in Snowflake or cloud data (Azure, AWS, GCP). #VisionaryFuture - Build the future, join our living ecosystem! 

Data Engineer Master at LUZA Group | Referso Jobs