Design, develop, test, deploy, and maintain scalable data pipelines using Databricks and related technologies.
- Design, develop, test, deploy, optimize, and support complex, scalable, production-grade data pipelines using Databricks and related data engineering technologies.
- Develop robust ETL/ELT solutions to ingest, transform, integrate, and deliver data across cloud and enterprise environments.
- Design reusable and maintainable data integration patterns leveraging Databricks, Apache Spark/PySpark, Python, SQL, Delta Lake, APIs, and other appropriate technologies.
- Design and maintain efficient data models, data structures, and storage solutions.
- Implement data quality, validation, reconciliation, monitoring, and error-handling processes to ensure reliable and accurate data delivery.
- Bachelor's degree in computer science, Information Systems, Engineering, Data Engineering, or a related field, or equivalent professional experience
- Nice to have: Microsoft Copilot
- Nice to have: AI tools
- Nice to have: AI integration
- Nice to have: AI assisted research
Sr. Data EngineerNewGM Financial IO · Monterrey, Mexico