Design, develop, test, deploy, and maintain scalable data pipelines using Databricks and related technologies.
Responsibilities
Design, develop, test, deploy, optimize, and support complex, scalable, production-grade data pipelines using Databricks and related data engineering technologies.
Develop robust ETL/ELT solutions to ingest, transform, integrate, and deliver data across cloud and enterprise environments.
Design reusable and maintainable data integration patterns leveraging Databricks, Apache Spark/PySpark, Python, SQL, Delta Lake, APIs, and other appropriate technologies.
Design and maintain efficient data models, data structures, and storage solutions.
Implement data quality, validation, reconciliation, monitoring, and error-handling processes to ensure reliable and accurate data delivery.
Requirements
Bachelor's degree in computer science, Information Systems, Engineering, Data Engineering, or a related field, or equivalent professional experience
Senior Forward Deployed Engineer focused on building scalable, secure data & analytics solutions for Humana’s enterprise, translating business needs into technical implementations.
Compensation
$117,600 - $161,700 per year
Responsibilities
Develop scalable and cost-efficient Data & ML solutions using Databricks and cloud-native services
Build and optimize ETL/ELT workflows for ingesting structured and unstructured healthcare data
Develop and maintain data models in enterprise data warehouses
Support Lakehouse architecture leveraging Databricks, Delta Lake, and cloud storage
Build real-time and batch pipelines for analytics and operational use cases
Requirements
Bachelor's in Computer Science, Engineering, or related field
This role transforms requirements into software according to design, to maximize business value and customer satisfaction, focusing on identity technologies and AI-native development.
Responsibilities
Uses programming, scripting and database languages to write software code that meets requirements and that optimizes software performances
Identifies existing software components, libraries and frameworks to reuse in the solutions
Applies knowledge of software development best practices, including coding standards, secure coding, code reviews, source control management, build processes, testing, and operations
Contributes to requirement (functional and non-functional) analysis and estimations
Supports software testing, deployment, maintenance, and evolution activities by correcting programming errors, responding to scope changes, and coding software enhancements
Seeking a motivated Data Engineer to join the GWAM Asia Data Project to deliver reliable, scalable, and high-quality data solutions supporting business and analytics initiatives across Canada and Asia.
Responsibilities
Design, develop, and support data pipelines and integrations across multiple source systems
Build ETL/ELT solutions using Azure Data Factory, Databricks, Synapse, Spark, Python, and SQL
Develop and maintain data ingestion, transformation, and data quality processes
Conduct proof-of-concepts (POCs) for new technologies and integration patterns
Monitor data pipelines and platform performance, troubleshoot issues, and optimize processing efficiency
Sr. Data EngineerGM Financial IO · Monterrey, Mexico
Data EngineerTEKsystems · Indianapolis, US
FullStack EngineerIDEMIA · Courbevoie, France
Senior Software EngineerJR Recruiting · Remote, US+3 more
Senior GCP Data EngineerBlackbuck Insights · Bengaluru, India