The Principal Engineer sets the technical direction for how the bank ingests, models, governs and serves data on a next-generation Databricks platform. This is a hands-on role involving lakehouse design, migration from legacy platforms, and setting engineering standards.
Responsibilities
Own the detailed design of the Databricks lakehouse: ingestion, bronze/silver/gold layers, Delta Lake design, Unity Catalog setup, and workspace and cluster configuration.
Lead the hands-on migration of legacy Hadoop/Hive/Spark and warehouse workloads to Databricks.
Set standards for SQL, PySpark and Delta Live Tables/Lakeflow pipelines, covering code review, testing, CI/CD and observability.
Tune performance and cost: partitioning, liquid clustering/Z-ordering, file compaction, join and shuffle tuning, Photon, cluster right-sizing and DBU spend governance.
Design and develop scalable ETL/ELT data pipelines on AWS. Build and maintain data lakes and data warehouse solutions using AWS services. Develop data processing solutions using PythonPySpark, and deliver interactive Power BI dashboards.
Compensation
Vendor Rate: ***/hr
Responsibilities
Design and develop scalable ETL/ELT data pipelines on AWS
Build and maintain data lakes and data warehouse solutions
Develop data processing solutions using AWS Glue, Amazon S3, AWS Lambda, Amazon Athena, and Amazon Redshift
Develop and optimize complex SQL queries for analytics and reporting
Use PythonPySpark for data processing, transformation, and automation
You own how data gets into Avra and what shape it is in when it arrives, covering data acquisition (crawlers, scrapers, browser automation) and the data platform (streams, pipelines, lakehouse).
Responsibilities
Build and run the acquisition layer: crawlers, scrapers and browser RPA that collect data from websites and portals, with scheduling, retries, session handling and change detection.
Keep collection reliable as sources change: detect layout and access changes early, track coverage and freshness per source, and repair quickly.
Run event-driven ingestion on Kafka and Pub/Sub, including ordering, replays, dead-letter queues, backpressure and idempotent consumers.
Build batch and incremental pipelines in Spark, dbt and SQL that turn raw captures into clean, typed, relational tables.
Own the lakehouse on Parquet and Iceberg: schema evolution, partitioning, compaction, and snapshots that make training sets reproducible.
The Principal Engineer sets the technical direction for how the bank ingests, models, governs and serves data using Databricks, leading lakehouse design, migration from legacy platforms, and mentoring engineers.
Responsibilities
Own the detailed design of the Databricks lakehouse: ingestion, bronze/silver/gold layers, Delta Lake design, Unity Catalog setup, and workspace and cluster configuration.
Lead the hands-on migration of legacy Hadoop/Hive/Spark and warehouse workloads to Databricks.
Set standards for SQL, PySpark and Delta Live Tables/Lakeflow pipelines, covering code review, testing, CI/CD and observability.
Tune performance and cost: partitioning, liquid clustering/Z-ordering, file compaction, join and shuffle tuning, Photon, cluster right-sizing and DBU spend governance.
Develop, maintain, and optimize Azure Data Pipelines using ADF or Azure Synapse, PySpark Notebooks, SQL Server Stored Procedures, and Logic Apps for enterprise data ingestion, transformation, orchestration, and integration, with focus on performance, scalability, and cost optimization, leveraging Generative AI and Agentic AI.
Responsibilities
Develop, maintain, and optimize Azure Data Pipelines using ADF or Azure Synapse, PySpark Notebooks, SQL Server Stored Procedures, and Logic Apps for enterprise data ingestion, transformation, orchestration, and integration, with focus on performance, scalability, and cost optimization.
Leverage Generative AI and Agentic AI to automate and accelerate data engineering activities such as SQL generation, pipeline development, data validation, reconciliation, testing, troubleshooting, and documentation.
Build API-based data tools and AI agents that securely interact with enterprise business data and expose governed data capabilities through MCP servers to enable natural-language access to business data
Support the modernization of existing Synapse workloads to Microsoft Fabric, including assessment and migration of pipelines and data workloads to Fabric Lakehouse and Fabric Data Warehouse
Collaborate with Data Engineering, BI, AI, and business teams to identify opportunities where AI and automation can reduce manual engineering effort and improve data accessibility and productivity
Requirements
Degree in Computer science / Information Technology / Artificial Intelligence or related discipline from a reputed institution with strong academic credentials
Intégrer l'équipe CERT en première ligne face à des menaces en constante évolution, où l'avance technique et la capacité d'adaptation font la différence. Le CERT opère et développe les capacités du SIEM d'OVHcloud.
Responsibilities
Administrer la plateforme SIEM et être force de proposition sur son évolution
Faire office de référent sur l'optimisation du requêtage de très grands volumes de données
Participer à l'élaboration de la stratégie de détection et son implémentation
Développer les capacités de traitement et d'analyse à grande échelle des journaux et collectes numériques (ETL)
Participer au développement et maintien de l'outillage contribuant aux capacités de détection et de supervision
Requirements
Nice to have: Connaissance approfondie de Splunk et de ses mécanismes internes
Nice to have: Développement et benchmark d'outils/prototypes s'appuyant sur des algorithmes ou méthodes statistiques
Nice to have: Entraînement de modèles facilitant le requêtage et l'analyse de très gros volumes de données en lien avec la sécurité des systèmes d'information
This role exists to scale and stabilize the core data infrastructure powering our real-time analytics and decision systems. You’ll help us deliver accurate, zero-latency business insights by designing robust ingestion pipelines, building clean semantic models, and maintaining rock-solid data governance across the platform.
Responsibilities
Design and implement scalable data transformation layers, organizing raw data into validated, production-grade data marts.
Build and optimize semantic layer models, ensuring consistent metrics and definitions across all reporting surfaces.
Establish data modeling standards utilizing optimal storage formats (Parquet, ORC, AVRO) and storage engines (PostgreSQL, ClickHouse, Redshift/BigQuery).
Ship and maintain end-to-end data ingestion pipelines integrating internal services and third-party event streams (Kafka, Kinesis, external APIs).
Automate data quality and integrity testing to catch pipeline breaks and silent schema drifts before they reach downstream consumers.
Requirements
Degree in Computer Science, Software Engineering, or equivalent practical experience
Intégrer l'équipe CERT en première ligne face à des menaces en constante évolution, où l'avance technique et la capacité d'adaptation font la différence.
Responsibilities
Élaborer et implémenter techniquement des politiques détection, de journalisation et de supervision
Associer les équipes métier à la stratégie de détection et au traitement des alertes qui en découlent
Comprendre techniquement et analyser les enjeux de sécurité et de détection des différents périmètres métiers
Mettre en œuvre et gérer des dispositifs de détection
Développer les capacités de collecte, transformation et exploitation à grande échelle orienté sécurité des journaux et collectes numériques (ETL)
Requirements
Nice to have: Splunk
Nice to have: SPL
Nice to have: Développement et benchmark d'outils/prototypes s'appuyant sur des algorithmes ou méthodes statistiques
Nice to have: Entraînement de modèles facilitant le requêtage et l'analyse de très gros volumes de données en lien avec la sécurité des systèmes d'information
Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service, implementing data transformation and quality.
Responsibilities
Migrate the existing Hadoop infrastructure to cloud infrastructure on Kubernetes Engine, COS, Spark as a service, and Airflow as a service
Implement data transformation and quality to ensure data consistency and accuracy
Set up CI/CD pipelines to automate deployments, unit testing and development management
Write and conduct unit and validation tests to ensure accuracy and integrity of code developed
Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly)