Senior Databricks Data Engineer
Build, refine, and maintain core data pipelines on the Databricks Lakehouse Platform to enable enterprise AI, analytics, and mission systems.
- Washington D.C., District of Columbia, United States +1 more
- Full-time
- Hybrid
- Posted Nov 16, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Locations (2)
- Washington D.C., District of Columbia, United States
- Quantico, Virginia, United States
Responsibilities
- Design, build, and maintain scalable data pipelines and ETL/ELT workflows on Databricks using Delta Lake, Delta Live Tables, and the medallion architecture
- Develop and orchestrate workflows using Databricks Workflows/Jobs
- Implement data quality checks, validation, lineage tracking, and metadata management using Unity Catalog and Lakehouse Monitoring
- Collaborate with other teams to ensure datasets meet requirements and are discoverable through Unity Catalog
- Automate ingestion and transformation processes using Databricks-native patterns such as Auto Loader, Structured Streaming, and the COPY INTO command
- Support API strategy, data modeling, and domain-driven data structures within the Lakehouse
- Troubleshoot pipeline issues and optimize Spark jobs and clusters for performance and cost
Requirements
- Experience in a Data engineering
- Experience in a AI/ML
Nice to have: Databricks certification, AI/ML pipelines, MLflow, Databricks Mosaic AI, Model Serving, Vector Search, Azure, AWS, multi-cloud data ecosystem, data governance, row/column-level security, DevOps/CI-CD patterns, Databricks Asset Bundles, Repos, Terraform, MuleSoft
Skills
DatabricksDelta LakeDelta Live TablesUnity CatalogApache SparkPySparkSpark SQLAzure DatabricksAWS GlueAzure Data FactoryStructured StreamingAuto LoaderSQLData modelingCloud-based storage patternsSecret clearanceDatabricksAzureAWSTerraformMuleSoft
More jobs nearby
Full description
N2IA TechnologiesCompany details are for members
Sign up for a free job alert to see N2IA Technologies's profile, website and LinkedIn, and the same for every employer on Referso Jobs.