Managing Consultant, Databricks Data Engineering Lead
Lead Databricks data engineering and DataOps delivery across ingestion, transformation, orchestration, migration, integration, serving, and consumption patterns.
- Arlington, Virginia, United States
- $130K–$216K per year
- Posted Nov 3, 2026
INDUSTRYHealthcareAllied Health & TherapyNursing
Responsibilities
- Lead Databricks data engineering and DataOps delivery across ingestion, transformation, orchestration, migration, integration, serving, and consumption patterns.
- Translate architecture, data models, mappings, data contracts, and migration requirements into scalable technical designs and delivery plans.
- Design and develop reusable pipelines, migration utilities, transformation frameworks, data-quality controls, reconciliation routines, and governed data products.
- Establish standards for coding, testing, CI/CD, deployment, observability, logging, error handling, performance, security, and operational support.
- Lead engineering reviews and troubleshoot Databricks job failures, pipeline bottlenecks, data-quality issues, and performance problems.
- Support batch and, where applicable, streaming data-processing patterns using Databricks, Apache Spark, and Delta Lake.
- Coordinate technical delivery with data architects, source-system teams, integration engineers, security specialists, governance leads, testing teams, and business stakeholders.
- Lead technical estimates, capacity planning, backlog refinement, sprint execution, release readiness, and stabilization activities.
- Mentor data engineers and ensure reusable code, design patterns, runbooks, and lessons learned are adopted across later modernization waves.
- Communicate technical decisions, risks, dependencies, and delivery impacts to client and program leadership.
Requirements
- Bachelor’s degree from an accredited university
- Experience in a federal agencies
- Experience in a public sector
Nice to have: Databricks Certified Data Engineer Professional, Unity Catalog, Delta Live Tables, Databricks Workflows, Auto Loader, cloud storage, identity and access management, secrets management, networking, platform security, Azure DevOps, GitHub Actions, Jenkins, Terraform, APIs, data services, integration patterns, event-driven pipelines, Agile Scrum or Kanban
Skills
data engineeringETL/ELTcloud data platformssoftware developmentanalytics engineeringDatabricksApache SparkPySparkPythonSQLDelta Lakeenterprise data migrationsource-to-target mappingdata conversionreconciliationvalidationdefect remediationdata-quality controlsmetadata capturelineageloggingmonitoringtechnical auditabilityGit-based developmentautomated testingCI/CDrelease managementproduction stabilizationDatabricksApache SparkPySparkPythonSQLDelta LakeGitAzure DevOpsGitHub ActionsJenkinsTerraform
Benefits
- Medical
- Rx
- Dental
- Vision Insurance
- Personal and Family Sick Time
- Company Paid Holidays
- discretionary variable incentive bonus
- Parental Leave
- Adoption Assistance
- 401(k) Retirement Plan
- Basic Life & Supplemental Life
- Health Savings Account
- Dental/Vision & Dependent Care Flexible Spending Accounts
- Short-Term & Long-Term Disability
- Student Loan PayDown
- Tuition Reimbursement
- Personal Development & Learning Opportunities
- Skills Development & Certifications
- Employee Referral Program
- Corporate Sponsored Events & Community Outreach
- Emergency Back-Up Childcare Program
- Mobility Stipend
More jobs nearby
Full description
Company details are for members
Sign up for a free job alert to see Guidehouse's profile, website and LinkedIn, and the same for every employer on Referso Jobs.