Back to search

Data Engineer - G0 Fusion

Design, develop, and migrate data integration pipelines and data products for Defence analytics.

  • Canberra, Australian Capital Territory, Australia
  • Posted Nov 10, 2026
INDUSTRYSoftware & InternetData & Analytics

Responsibilities

  • Design and implement data integration pipelines sourcing logistics and sustainment data from legacy applications
  • Collaborate with stakeholders to analyse data structures and develop data mappings
  • Generate and revise data object designs across relational and data mesh environments
  • Research and develop data migration strategies and integration mechanisms
  • Support testing, verification and operational acceptance of migrated datasets
  • Support migration of analytical data assets from legacy warehouse to enterprise data mesh
  • Design and develop domain-aligned data products for self-service analytics
  • Transform landed data into centrally managed warehouse STAR schema
  • Support implementation of federated governance and data discoverability
  • Design and develop business-ready data marts and analytical models
  • Develop conformed dimensions and shared business entities
  • Support data engineering for dimensional, data vault and hybrid modelling
  • Analyse semantic-ready datasets suitability for Army use cases
  • Apply DevSecOps, CI/CD and pipeline execution
  • Ensure compliance with governance, security, privacy and information management policies

Requirements

Nice to have: Data Vault 2.0, SAP, Defence domain, Cloudera, Hive, Impala, Ozone, Iceberg, Spark, Databricks

Skills

SQLPythonETL/ELTdata warehousedata modelingdata vaultdata meshDevSecOpsCI/CDAgile ScrumClouderaHiveImpalaOzoneIcebergSparkDatabricks

Full description

Under direction of the Commonwealth, undertake the following duties: Enterprise Data Migration • Design and implement data integration pipelines that source logistics and sustainment data from legacy applications • Collaborate with stakeholders including Business Analysts, Data Architects and developers, analyse logistics, maintenance, inventory, supply chain, procurement and asset management data structures and develop data mappings • Generate and revise suggested data object designs across relational and data mesh environments as part of the prescribed data generation life cycle for Army analytical products • Research and develop data migration strategies, cutover approaches and ongoing integration mechanisms between legacy data source and target data sources plus platform migration. • Support testing, verification and operational acceptance of migrated logistics datasets. Legacy Data Warehouse to Enterprise Data Mesh Migration • Support the migration of analytical data assets, from Army legacy data warehouse into a Defence enterprise data mesh architecture. • Design and develop domain-aligned data products that support self-service analytics, reporting and decision support capabilities. • Transform landed data into centrally managed warehouse STAR schema plus governed, reusable data products aligned to Data Mesh principles. • Support implementation of federated governance, data discoverability and enterprise-wide data sharing capabilities. Data Product and Data Mart Development • Design and develop business-ready data marts and analytical models supporting: • Organisational structure and hierarchy management • Logistics and inventory management • Maintenance and sustainment management • Equipment readiness and asset visibility • Workforce and establishment reporting • Operational planning and decision support • Develop conformed dimensions and shared business entities to ensure consistency across analytical domains. • Support data engineering for dimensional, data vault and hybrid modelling approaches as appropriate to support enterprise analytics requirements. • Analyse enterprise semantic-ready datasets suitability for Army use cases. Data Engineering and Platform Development • Apply DevSecOps, CI/CD and pipeline execution where appropriate. • Ensure compliance with enterprise governance, security, privacy and information management policies. Including standards for data quality, stewardship and lifecycle management, and master data management. Requirements Minimum 5 years dedicated data engineering experience across: · SQL development including 3NF design, STAR schema design and implementation, in a data warehouse context. · Agile development, preferably Scrum. · Experience migrating legacy data warehouse environments to preferably modern analytical platforms or experience with large application data migration or refactoring. · Python scripting, data engineering or data analysis · Data DevOps including ETL/ELT pipeline execution, data quality controls / verification · Datamart design, build and testing. · SQL code optimisation and refactoring. · Python scripting and data transformation. Desirable · Experience with Data Vault 2.0 patterns, data mesh structures · Experience with the logistics systems and logistics business domain, especially in a SAP enterprise context. · Experience with Defence or related industries such as capability development and delivery, sustainment or operational planning. · Experience with data engineering of sensitive datasets at SECRET, protected identities (PI) and personality identifiable information (PII) · Working in a large team on a complex application in a decision support or data analytics context. · Cloudera data analytics suite (CDV, CML etc) including Hive, Impala, Ozone, Iceberg, Spark or contemporary suite eg Databricks including data mesh concepts.

Data Engineer - G0 Fusion at indigitise | Referso Jobs