- Bengaluru, Karnataka, India
- Full-time · Manager
- 6–10 years
Experienced Data Engineer to lead and perform hands-on development of scalable, cloud-native data engineering solutions using Python, PySpark, and AWS services.
Responsibilities
- Lead and perform hands-on development of data engineering solutions, writing clean, efficient, and maintainable code in Python, PySpark, and other relevant programming languages.
- Design, develop, and deploy cloud-native solutions on AWS, leveraging Compute services (EC2, Lambda) and Storage services (S3) to build scalable data platforms.
- Design and manage database solutions using RDS, Aurora, Postgres, and DynamoDB to support structured and unstructured data workloads.
- Build and orchestrate data workflows using Apache Airflow, AWS Step Functions, and SNS for reliable, automated pipeline execution.
- Develop and optimize ETL/analytics pipelines using AWS Glue, EMR, Athena, and Redshift for large-scale data processing and analytics.
Requirements
- Master of Engineering
- Bachelor of Engineering
- Nice to have: APIs
- Nice to have: SSO
- Nice to have: Kafka