Back to search

Data Engineer with GCP

Design, develop, and maintain scalable data pipelines using GCP services.

  • Sydney, New South Wales, Australia
  • Posted Nov 12, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics

Responsibilities

  • Design, develop, and maintain scalable data pipelines using GCP services
  • Build and optimise ETL/ELT workflows for batch and real-time data processing
  • Work with Google BigQuery for data warehousing, SQL development, and query optimisation
  • Develop data processing solutions using Python, PySpark, and Apache Beam
  • Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub
  • Build and manage data lakes and data warehouses on Google Cloud
  • Implement data quality checks, data validation, and monitoring
  • Optimise pipeline performance, scalability, and cost efficiency
  • Collaborate with data analysts, data scientists, architects, and business teams
  • Ensure data security, governance, and compliance best practices

Requirements

  • Experience in a Data Warehousing

Skills

Google Cloud Platform (GCP)BigQueryPythonSQLETL/ELT data pipelinesCloud DataflowApache BeamCloud Storage (GCS)data modellingdata warehousingbatch data processingreal-time data processingGCPBigQueryPythonPySparkApache BeamCloud DataflowCloud ComposerPub/SubCloud Storage (GCS)

Full description

Key Responsibilities Design, develop, and maintain scalable data pipelines using GCP services. Build and optimise ETL/ELT workflows for batch and real-time data processing. Work with Google BigQuery for data warehousing, SQL development, and query optimisation. Develop data processing solutions using Python, PySpark, and Apache Beam. Implement data integration using Cloud Dataflow, Cloud Composer, and Pub/Sub. Build and manage data lakes and data warehouses on Google Cloud. Implement data quality checks, data validation, and monitoring. Optimise pipeline performance, scalability, and cost efficiency. Collaborate with data analysts, data scientists, architects, and business teams. Ensure data security, governance, and compliance best practices. Mandatory Technical Skills Strong experience in Google Cloud Platform (GCP). Hands-on experience with BigQuery. Strong programming skills in Python and SQL. Experience developing ETL/ELT data pipelines. Experience with Cloud Dataflow and/or Apache Beam. Knowledge of Cloud Storage (GCS). Experience with data modelling and data warehousing. Experience with batch and real-time data processing.

Data Engineer with GCP at XPT Software Australia Pty Ltd | Referso Jobs