Back to search

Senior Databricks Engineer

Seeking a highly skilled Senior Databricks Engineer with deep expertise in Python, Databricks, Unity Catalog, Data Governance, and Data Quality to lead the design and implementation of scalable data governance and data platform solutions.

  • Atlanta, Georgia, United States
  • Full-time
  • On-site
  • $60–$70 per hour
  • Posted Nov 17, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software

Responsibilities

  • Design, develop, and support enterprise-scale solutions on the Databricks Lakehouse Platform
  • Build and optimize data pipelines using Databricks, PySpark, SQL, and Python
  • Develop reusable, configuration-driven frameworks for data quality validation, metadata management, and governance automation
  • Implement scalable ingestion, transformation, and validation processes across structured and semi-structured data
  • Troubleshoot performance bottlenecks and optimize Databricks workloads
  • Implement and manage Unity Catalog governance capabilities
  • Design and develop enterprise-grade Python applications and utilities
  • Design and implement automated data quality validation frameworks
  • Contribute to platform architecture and design reviews
  • Partner with business, governance, and technology stakeholders to understand requirements and priorities

Requirements

  • Experience in a Data Engineering
  • Experience in a Analytics Engineering
  • Experience in a Data Platform Engineering

Skills

Databricks Lakehouse PlatformPySparkSQLDelta LakeUnity CatalogData GovernanceData QualityMetadata ManagementData LineagePythonAzure cloud platformCI/CDGitDevOpsDatabricksPythonPySparkSQLUnity CatalogDelta LakeAzure

Benefits

  • medical insurance
  • dental insurance
  • vision insurance
  • flexible spending or health savings account
  • AD&D insurance
  • employee assistance
  • 401k program

More jobs nearby

Full description

Company Overview: Req ID: 398192 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. NTT DATA's Client is currently seeking a Senior Databricks Engineer to join their team in Atlanta, Georgia (US-GA), United States (US). Job Description: Job Title: Senior Databricks Engineer / Technical Product Manager (80% Engineering | 20% Product Management) Job Summary We are seeking a highly skilled Senior Databricks Engineer with deep expertise in Python, Databricks, Unity Catalog, Data Governance, and Data Quality to lead the design and implementation of scalable data governance and data platform solutions. This role is primarily hands-on technical (80%), requiring strong engineering capabilities, while also partnering with business and technology stakeholders on product management activities (20%), including roadmap planning, requirements gathering, and stakeholder alignment. The ideal candidate combines strong software engineering and data platform expertise with the ability to translate governance and business requirements into scalable technical solutions. Key Responsibilities Technical Engineering (80%) Databricks & Data Platform Engineering Design, develop, and support enterprise-scale solutions on the Databricks Lakehouse Platform. Build and optimize data pipelines using Databricks, PySpark, SQL, and Python. Develop reusable, configuration-driven frameworks for data quality validation, metadata management, and governance automation. Implement scalable ingestion, transformation, and validation processes across structured and semi-structured data. Troubleshoot performance bottlenecks and optimize Databricks workloads. Unity Catalog & Data Governance Implement and manage Unity Catalog governance capabilities, including: Catalogs, Schemas, and Tables Access controls and permissions Data lineage Data classification and tagging Business and technical metadata management Partner with governance teams to establish data ownership, stewardship, and governance controls. Enable governance integration between enterprise governance tools and Databricks. Define and implement metadata standards, data quality controls, and governance policies. Python Development Design and develop enterprise-grade Python applications and utilities. Build APIs, automation tools, and governance accelerators. Develop reusable Python modules, testing frameworks, and deployment pipelines. Perform code reviews and establish engineering best practices. Data Quality & Metadata Management Design and implement automated data quality validation frameworks. Define quality rules, thresholds, monitoring, and exception handling processes. Develop metadata harvesting, synchronization, and lineage solutions. Support data observability and monitoring initiatives. Architecture & Technical Leadership Contribute to platform architecture and design reviews. Define engineering standards, governance frameworks, and development best practices. Mentor junior engineers and provide technical leadership. Collaborate with cloud, security, architecture, and governance teams. Product Management Activities (20%) Stakeholder Engagement Partner with business, governance, and technology stakeholders to understand requirements and priorities. Translate business needs into technical specifications and delivery plans. Facilitate discussions between engineering and business teams. Product Delivery Define and manage backlog, epics, features, and user stories. Support roadmap planning and prioritization activities. Drive solution adoption through demonstrations and stakeholder engagement. Track delivery progress, risks, dependencies, and outcomes. Strategy & Governance Help define the strategic direction for governance and data platform capabilities. Evaluate new technologies, governance tools, and platform enhancements. Develop business cases and recommendations for platform investments. Must have Technical Skills 8+ years of experience in Data Engineering, Analytics Engineering, or Data Platform Engineering. 5+ years of hands-on Databricks experience. Expert-level Python programming skills. Strong experience with: Databricks Lakehouse Platform PySpark SQL Delta Lake Unity Catalog Deep understanding of: Data Governance Data Quality Metadata Management Data Lineage Master and Reference Data Concepts Experience building APIs and automation frameworks. Strong understanding of CI/CD, Git, and DevOps practices. Experience with Azure cloud platform. Ideal Candidate Thinks like an engineer and builds like an architect. Has deep Databricks and Unity Catalog expertise. Understands governance beyond compliance and can operationalize it through technology. Can independently drive technical solutions from concept to production. Effectively balances hands-on engineering with stakeholder and product management responsibilities. Allocation: 80% Technical Engineering | 20% Product Management About NTT DATA: NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is [$60-$70 hourly]. Actual compensation will depend on a number of factors, including the candidate’s relevant experience, technical skills, and other qualifications. This position is eligible for company benefits including participation in medical, dental, and vision insurance, flexible spending or health savings account, and AD&D insurance, employee assistance, participation in a 401k program, and additional voluntary or legally-required benefits NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.

Senior Databricks Engineer at NTT DATA | Referso Jobs