Senior Data Engineer
infynd · Posted Nov 13, 2026
- Coimbatore, Tamil Nadu, India
- Full-time · Senior
- 4+ years
Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory and Azure Databricks, focusing on large-scale distributed data processing.
Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using Azure Data Factory and Azure Databricks
- Develop data ingestion and transformation workflows using Python, SQL, and PySpark
- Implement batch processing, incremental loading, full loading, and Change Data Capture (CDC) mechanisms
- Integrate data from multiple sources, including relational databases, APIs, and cloud storage
- Develop and optimize data models, fact tables, dimension tables, and data warehouse structures
Requirements
- Nice to have: Pandas
- Nice to have: NumPy
- Nice to have: OOP concepts
- Nice to have: API integration