Lead data engineering engagements, design and maintain scalable data pipelines using Spark, PySpark, and Python, manage a team of data engineers, and collaborate with cross-functional stakeholders to deliver high-quality data solutions.
- Design, develop, and maintain scalable data pipelines and architectures using Spark, PySpark, and Python.
- Lead and manage a team of data engineers, providing technical guidance, mentorship, and performance management.
- Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
- Ensure data quality, integrity, and security across all data engineering projects.
- Implement best practices for data engineering, including code reviews, testing, and documentation.
- Bachelor of Engineering
- Master of Business Administration
- Nice to have: BigQuery
- Nice to have: Redshift
- Nice to have: S3