Back to search

Databricks Developer

Design, develop, and optimize scalable data processing solutions on the Databricks Lakehouse Platform.

  • Louisville, Kentucky, United States
  • Full-time
  • $38–$49 per hour
  • Posted Nov 17, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics

Responsibilities

  • Design, develop, and maintain scalable batch and real-time data pipelines using Databricks
  • Develop robust data solutions using PySpark, Spark SQL, and Delta Lake
  • Implement data validation, quality checks, and performance tuning
  • Design and manage data architecture within the Databricks Lakehouse Platform
  • Implement Delta Lake tables, partitioning, optimization, and schema evolution
  • Develop data models to support analytics and reporting requirements
  • Ensure data reliability, scalability, and governance
  • Analyze and optimize Spark jobs for performance and cost efficiency
  • Monitor cluster utilization and implement best practices for resource management
  • Troubleshoot bottlenecks in data processing workflows
  • Improve processing times through caching, partitioning, and query optimization techniques
  • Implement role-based access controls and data security standards
  • Support data governance initiatives, lineage tracking, and compliance requirements
  • Ensure adherence to enterprise data management policies
  • Work closely with Data Architects, Data Scientists, Business Analysts, and Application Teams
  • Participate in Agile development processes and sprint ceremonies
  • Prepare technical design documentation and support knowledge transfer activities

Requirements

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or related field
  • Experience in a Data Engineering

Skills

DatabricksApache SparkPySparkSpark SQLDelta LakeDatabricks Lakehouse Platform

More jobs nearby

Full description

Pay Rate Range: $37.87 - 49.24/hr. Databricks Developer Job Description: We are seeking a skilled Databricks Developer to design, develop, and optimize scalable data processing solutions on the Databricks Lakehouse Platform. The role involves building high-performance data pipelines, supporting analytics initiatives, and enabling enterprise-scale data modernization. Key Responsibilities Data Engineering & Development · Design, develop, and maintain scalable batch and real-time data pipelines using Databricks. · Develop robust data solutions using PySpark, Spark SQL, and Delta Lake. · Implement data validation, quality checks, and performance tuning. Data Lakehouse Management · Design and manage data architecture within the Databricks Lakehouse Platform. · Implement Delta Lake tables, partitioning, optimization, and schema evolution. · Develop data models to support analytics and reporting requirements. · Ensure data reliability, scalability, and governance. Performance Optimization · Analyze and optimize Spark jobs for performance and cost efficiency. · Monitor cluster utilization and implement best practices for resource management. · Troubleshoot bottlenecks in data processing workflows. · Improve processing times through caching, partitioning, and query optimization techniques. Data Governance & Security · Implement role-based access controls and data security standards. · Support data governance initiatives, lineage tracking, and compliance requirements. · Ensure adherence to enterprise data management policies. Collaboration & Delivery · Work closely with Data Architects, Data Scientists, Business Analysts, and Application Teams. · Participate in Agile development processes and sprint ceremonies. · Prepare technical design documentation and support knowledge transfer activities. Required Qualifications · Bachelor's degree in Computer Science, Information Systems, Engineering, or related field. · 4+ years of hands-on Databricks development experience. · Strong expertise in Apache Spark and Databricks Lakehouse Platform. · Experience developing data pipelines using PySpark and Spark SQL. Essential Skills: Databricks Skills: Digital : Databricks Experience Required: 8-10 years Skills: Category Name Required Importance Experience SkillCategoryTest1_MN Databricks Yes 1 2-4 years

Databricks Developer at Varite, Inc | Referso Jobs