- Arlington, Virginia, United States
- 5+ years
Support the Department of Veterans Affairs (VA) Summit Advanced Tooling, Lakehouse, and Artificial Intelligence Services (Summit ATLAS) program by developing, maintaining, and optimizing ETL and ELT pipelines for enterprise data integration.
Responsibilities
- Design, develop, and maintain ETL and ELT pipelines
- Develop and optimize data transformation workflows using Azure Data Factory, Azure Databricks, SQL, Python
- Implement batch, incremental, and streaming data integration processes
- Transform raw data into standardized datasets
- Develop and maintain pipeline orchestration, scheduling, and error-handling
Requirements
- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline
- Nice to have: Experience supporting VA or other federal agency data modernization initiatives
- Nice to have: Experience migrating legacy ETL processes to Microsoft Azure cloud environments
- Nice to have: Experience with Delta Lake, Azure Synapse Analytics, or dedicated SQL pools
- Nice to have: Experience implementing streaming or event-driven data integration using Apache Kafka
