- Chennai, Tamil Nadu, India
- Mid
- 3–7 years
Develop, maintain, and optimize Azure Data Pipelines using ADF or Azure Synapse, PySpark Notebooks, SQL Server Stored Procedures, and Logic Apps for enterprise data ingestion, transformation, orchestration, and integration, with focus on performance, scalability, and cost optimization, leveraging Generative AI and Agentic AI.
Responsibilities
- Develop, maintain, and optimize Azure Data Pipelines using ADF or Azure Synapse, PySpark Notebooks, SQL Server Stored Procedures, and Logic Apps for enterprise data ingestion, transformation, orchestration, and integration, with focus on performance, scalability, and cost optimization.
- Leverage Generative AI and Agentic AI to automate and accelerate data engineering activities such as SQL generation, pipeline development, data validation, reconciliation, testing, troubleshooting, and documentation.
- Build API-based data tools and AI agents that securely interact with enterprise business data and expose governed data capabilities through MCP servers to enable natural-language access to business data
- Support the modernization of existing Synapse workloads to Microsoft Fabric, including assessment and migration of pipelines and data workloads to Fabric Lakehouse and Fabric Data Warehouse
- Collaborate with Data Engineering, BI, AI, and business teams to identify opportunities where AI and automation can reduce manual engineering effort and improve data accessibility and productivity
Requirements
- Degree in Computer science / Information Technology / Artificial Intelligence or related discipline from a reputed institution with strong academic credentials