- McLean, Virginia, United States
- $155K–$185K per year
Credence has an immediate need for an AWS Databricks Engineer to join our growing AI and Automation practice. You will serve as a key technical contributor responsible for designing, building, and optimizing scalable cloud-based data solutions using AWS and Databricks.
Compensation
Salary Range: $155,000 - $185,000 annually. Actual compensation will be determined based on the selected candidate's experience, education, certifications, skills, and overall qualifications.
Responsibilities
- Design, build, and optimize scalable data pipelines and processing workflows using Databricks, Apache Spark, PySpark, and Delta Lake.
- Design and implement modern lakehouse solutions using Databricks and AWS services.
- Build and maintain ETL/ELT pipelines integrating structured, semi-structured, and unstructured data across AWS services such as S3, Glue, RDS, Redshift, Lambda, and related cloud data platforms.
- Develop efficient data transformation workflows using SQL, Python, and PySpark.
- Optimize Spark workloads, queries, clusters, and storage configurations for performance, reliability, and cost efficiency.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, Engineering, or a related technical field.
- Nice to have: Databricks Lakehouse Architecture
- Nice to have: Databricks Unity Catalog
- Nice to have: Delta Live Tables
- Nice to have: Databricks Workflows