Back to search

Data Engineer

Design, build, and optimize scalable cloud-based data pipelines and infrastructure.

  • Atlanta, Georgia, United States
  • Posted Nov 10, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software

Responsibilities

  • Design, develop, and maintain scalable cloud-based data pipelines using AWS, Databricks, PySpark, Python, and SQL.
  • Build and optimize ETL/ELT processes, data models, and data warehousing solutions.
  • Optimize Spark and SQL workloads for performance, reliability, and cost efficiency.
  • Monitor, troubleshoot, and support production data pipelines.
  • Implement CI/CD, automated deployments, unit testing, and code quality standards.
  • Collaborate with cross-functional teams to translate business requirements into scalable data solutions.
  • Document technical designs, data flows, and processes.

Requirements

  • Bachelor's or Master's degree in Computer Science, Statistics, Analytics, or related field.

Nice to have: Kafka, Kinesis, AWS Glue, AWS Lambda, MongoDB, Terraform, Power BI, Tableau

Skills

AWSDatabricksPySparkPythonSQLETL/ELTdata modelingdata warehousingSpark performance tuningCI/CD

More jobs nearby

Full description

Data Engineer We are seeking a Data Engineer to design, build, and optimize scalable cloud-based data pipelines and infrastructure. This role will focus on developing production-ready data solutions using AWS, Databricks, PySpark, SQL, and Python to support analytics, reporting, and business intelligence. Key Responsibilities Design, develop, and maintain scalable cloud-based data pipelines using AWS, Databricks, PySpark, Python, and SQL. Build and optimize ETL/ELT processes, data models, and data warehousing solutions. Optimize Spark and SQL workloads for performance, reliability, and cost efficiency. Monitor, troubleshoot, and support production data pipelines. Implement CI/CD, automated deployments, unit testing, and code quality standards. Collaborate with cross-functional teams to translate business requirements into scalable data solutions. Document technical designs, data flows, and processes. Required Qualifications Bachelor's or Master's degree in Computer Science, Statistics, Analytics, or related field. 3–5+ years of hands-on Data Engineering experience. Strong experience with AWS, Databricks, PySpark, Python, and SQL. Experience building and supporting production data pipelines. Strong understanding of ETL/ELT, data modeling, and data warehousing. Experience with SQL query optimization, Spark performance tuning, and CI/CD. Strong troubleshooting, problem-solving, and communication skills. Preferred Qualifications Experience with Kafka, Kinesis, AWS Glue, or AWS Lambda. Familiarity with MongoDB and Terraform. Experience with Power BI or Tableau.

Data Engineer at Advanced Tech Placement | Referso Jobs