- Merrifield, Virginia, United States
- On-site
- Full-time · Senior
- $185K–$185K per year
- 12+ years
Modernizing data warehouse pipeline architecture by gradually reducing reliance on SSIS and SQL-only patterns, introducing Python-based ETL, improving modularity, and setting the groundwork for a future move into PySpark, distributed compute, and eventually Databricks or similar cloud platforms.
Compensation
USD $185,000.00 - USD $185,000.00 /Yr.
Responsibilities
- Learn and understand the existing Kimball-modeled SQL Server structure over time
- Reverse-engineer SSIS packages and convert them into Python-based modular ETL pipelines
- Build reusable Python frameworks for extraction, transformation, and loading
- Begin introducing PySpark for scalable transformation patterns
- Contribute to planning a future transition path (Databricks, Azure Synapse, Snowflake, etc.)
Requirements
- Bachelor's
- Nice to have: Experience modernizing legacy ETL systems