Cleared Data Engineer
Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines in Databricks using Python, PySpark, SQL, and reusable engineering patterns.
- Arlington, Virginia, United States
- Full-time
- On-site
- $85K–$141K per year
- Posted Nov 13, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics
Responsibilities
- Design, develop, test, deploy, and maintain scalable batch and streaming data pipelines in Databricks using Python, PySpark, SQL, and reusable engineering patterns.
- Transform raw source data into curated, analysis-ready datasets and dimensional models that support cybersecurity metrics, risk analysis, dashboards, and executive reporting.
- Develop automated data-quality controls for ETL jobs, including schema, completeness, validity, consistency, uniqueness, timeliness, referential-integrity, and source-to-target reconciliation checks.
- Schedule and orchestrate production workflows; monitor job status, freshness, throughput, latency, resource utilization, and failures; troubleshoot root causes; and restore processing within agreed service levels.
- Optimize pipeline reliability, performance, and cost through efficient transformations, workload configuration, incremental processing, partitioning, and compute-resource management.
- Implement and maintain data-governance and quality-assurance standards, including access controls, metadata, data classification, ownership, lineage, retention, auditability, and protection of sensitive cybersecurity information.
- Maintain source-to-target mappings, data dictionaries, transformation rules, validation evidence, standard operating procedures, runbooks, and other technical documentation needed for operations, knowledge transfer, and audit readiness.
- Partner with cybersecurity analysts, data owners, system administrators, dashboard developers, and business stakeholders to define data requirements, metrics, thresholds, and acceptance criteria.
- Maintain effective working relationships with client management and staff, anticipate stakeholder needs, communicate delivery risks and dependencies, and resolve issues in a timely and professional manner.
- Organize and lead client meetings by coordinating schedules, developing and distributing agendas and pre-read materials, facilitating discussions and decisions, recording minutes, maintaining required documentation, and tracking action items through closure.
- Participate in peer reviews, testing, release activities, and continuous-improvement efforts to strengthen engineering practices, reduce recurring defects, and improve the reliability and usability of data products.
Requirements
- Bachelor’s degree
- Experience in a Cybersecurity
Nice to have: Master’s degree in computer science or related field, System and application logs
Skills
Benefits
- Medical, Rx, Dental & Vision Insurance
- Personal and Family Sick Time & Company Paid Holidays
- Discretionary variable incentive bonus
- Parental Leave and Adoption Assistance
- 401(k) Retirement Plan
- Basic Life & Supplemental Life
- Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts
- Short-Term & Long-Term Disability
- Student Loan PayDown
- Tuition Reimbursement, Personal Development & Learning Opportunities
- Skills Development & Certifications
- Employee Referral Program
- Corporate Sponsored Events & Community Outreach
- Emergency Back-Up Childcare Program
- Mobility Stipend
More jobs nearby
Full description
Company details are for members
Sign up for a free job alert to see Guidehouse's profile, website and LinkedIn, and the same for every employer on Referso Jobs.