Data Engineer
- Cary, North Carolina, United States
- Contract
- On-site
- $50–$60 per hour
- Posted Nov 13, 2026
INDUSTRYSoftware & InternetData & Analytics
Responsibilities
- Collect, store, process and analyze large datasets to build and implement extract, transfer, load (ETL) processes.
- Lead migration of data pipelines from Synapse to Databricks.
- Architect and implement batch + real-time data pipelines using PySpark, Databricks, and Event Hubs.
- Establish data engineering best practices and mentor junior engineers.
- Drive CI/CD automation with AzDO and Git.
- Ensure data quality, governance, and compliance (Collibra).
- Collaborate with business/tech teams; leverage insurance domain knowledge where applicable.
- Develop reusable frameworks to reduce the development effort involved thereby ensuring cost savings for the projects.
- Develop quality code with thought through performance Eligible to workimizations in place right at the development stage.
- Appetite to learn new technologies and be ready to work on new cutting-edge cloud technologies.
- Work with team spread across the globe in driving the delivery of projects and recommend development and performance improvements.
Skills
PySparkDatabricksEvent HubsAzureSynapseCI/CDAzDOGitCollibraETLdata pipelinesPySparkDatabricksEvent HubsAzureSynapseAzDOGitCollibra
More jobs nearby
Full description
Diverse Lynx
Company details are for members
Sign up for a free job alert to see Diverse Lynx's profile, website and LinkedIn, and the same for every employer on Referso Jobs.