- Washington D.C., District of Columbia, United States +1 more
- Hybrid
- Full-time · Senior
- 3+ years
Build, refine, and maintain core data pipelines on the Databricks Lakehouse Platform to enable enterprise AI, analytics, and mission systems.
Locations (2)
- Washington D.C., District of Columbia, United States
- Quantico, Virginia, United States
Responsibilities
- Design, build, and maintain scalable data pipelines and ETL/ELT workflows on Databricks using Delta Lake, Delta Live Tables, and the medallion architecture
- Develop and orchestrate workflows using Databricks Workflows/Jobs
- Implement data quality checks, validation, lineage tracking, and metadata management using Unity Catalog and Lakehouse Monitoring
- Collaborate with other teams to ensure datasets meet requirements and are discoverable through Unity Catalog
- Automate ingestion and transformation processes using Databricks-native patterns such as Auto Loader, Structured Streaming, and the COPY INTO command
