- Senior
Senior Data Engineer
Responsibilities
- Design, develop, test, and support scalable data pipelines and ETL/ELT solutions using Azure Databricks, PySpark, SQL, and cloud-native technologies
- Contribute to the NHI Cloud Modernization program by migrating and modernizing legacy Teradata, DataStage, Unix, and SAS-based data processing workloads to Azure Databricks and Snowflake
- Develop and maintain data ingestion, transformation, and data quality frameworks supporting Bronze, Silver, and Gold data layers within the enterprise lakehouse architecture
- Build reusable and optimized PySpark components, notebooks, and workflows to process large-scale healthcare claims, membership, provider, and ancillary datasets
- Implement monitoring, logging, alerting, exception handling, and operational automation to improve platform reliability and supportability