Back to search

Data Engineer

  • Cary, North Carolina, United States
  • Contract
  • On-site
  • $50–$60 per hour
  • Posted Nov 13, 2026
INDUSTRYSoftware & InternetData & Analytics

Responsibilities

  • Collect, store, process and analyze large datasets to build and implement extract, transfer, load (ETL) processes.
  • Lead migration of data pipelines from Synapse to Databricks.
  • Architect and implement batch + real-time data pipelines using PySpark, Databricks, and Event Hubs.
  • Establish data engineering best practices and mentor junior engineers.
  • Drive CI/CD automation with AzDO and Git.
  • Ensure data quality, governance, and compliance (Collibra).
  • Collaborate with business/tech teams; leverage insurance domain knowledge where applicable.
  • Develop reusable frameworks to reduce the development effort involved thereby ensuring cost savings for the projects.
  • Develop quality code with thought through performance Eligible to workimizations in place right at the development stage.
  • Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies.
  • Work with team spread across the globe in driving the delivery of projects and recommend development and performance improvements.

Skills

PySparkDatabricksEvent HubsAzureSynapseCI/CDAzDOGitCollibraETLdata pipelinesPySparkDatabricksEvent HubsAzureSynapseAzDOGitCollibra

More jobs nearby

Full description

Job Details Role : Azure Data Engineer Location : Cary , NC – Onsite Type : Contract Key Responsibilities: • Collect, store, process and analyze large datasets to build and implement extract, transfer, load (ETL) processes. • Lead migration of data pipelines from Synapse to Databricks. • Architect and implement batch + real-time data pipelines using PySpark, Databricks, and Event Hubs. • Establish data engineering best practices and mentor junior engineers. • Drive CI/CD automation with AzDO and Git. • Ensure data quality, governance, and compliance (Collibra). • Collaborate with business/tech teams; leverage insurance domain knowledge where applicable. • Develop reusable frameworks to reduce the development effort involved thereby ensuring cost savings for the projects. • Develop quality code with thought through performance Eligible to workimizations in place right at the development stage. • Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies. • Work with team spread across the globe in driving the delivery of projects and recommend development and performance improvements. Payrate : 50 - 60/hr

Data Engineer at Diverse Lynx | Referso Jobs