GCP Data Engineer FR
Design, develop and maintain ELT/ETL pipelines to ingest, process and store large volumes of data, and build data models on GCP.
- Lisbon, Lisbon District, Portugal
- Full-time
- Hybrid
- Posted Jan 1, 2024
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Design, develop and maintain ELT/ETL pipelines to ingest, process and store large volumes of data
- Build data models and schemas (data warehouse/data lake) on GCP
- Develop in Python for transformations, orchestration, automation and data quality checks
- Help integrate and operationalize AI prediction models within cloud data pipelines
- Plan and execute UAT/QA testing, validating data correctness and release-ready pipelines
- Implement data quality, monitoring and alerting, ensuring governance, security and compliance (IAM, encryption, access controls)
- Create technical documentation, runbooks and test plans in English and French
- Work with Data Engineers, Data Scientists, Analysts and business stakeholders, and take part in code reviews and Agile/Scrum ceremonies
Requirements
- Experience in a finance
- Experience in a healthcare
- Experience in a telecom
Nice to have: Spark/Databricks, BI tools, GDPR, Vertex AI, streaming (Kafka)
Skills
PythonSQLETL/ELTData modelingSchema designGCP: BigQueryGCP: Cloud StorageGCP: Dataflow/BeamGCP: DataprocGCP: Pub/SubGCP: Cloud Composer/AirflowCI/CDGitUnderstanding of AI prediction modelsFluency in French (minimum C1)Professional proficiency in EnglishBigQueryCloud StorageDataflow/BeamDataprocPub/SubCloud Composer/AirflowControl-M
Full description
NimberCompany details are for members
Sign up for a free job alert to see Nimber's profile, website and LinkedIn, and the same for every employer on Referso Jobs.