Senior Azure Data Engineer
Design, develop, and maintain scalable data pipelines and Big Data solutions on Microsoft Azure and related platforms.
- Posted Nov 13, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Design, develop, and maintain scalable data pipelines using PySpark, Spark SQL, Python, SQL, and Azure Synapse Analytics.
- Build and optimize ETL/ELT workflows for large-volume structured, semi-structured, and unstructured data processing.
- Develop and support Azure Synapse pipelines, notebooks, SQL scripts, stored procedures, views, and data transformation logic.
- Work with Azure Data Lake Storage Gen2, Azure Data Factory, Azure Databricks, Azure SQL Database, and related Azure data services.
- Develop and support Big Data solutions using technologies such as Apache Spark, Hadoop, HDFS, Hive, Sqoop, Kafka, HBase, and related distributed data processing components.
- Translate business requirements and functional specifications into detailed technical designs and reusable data engineering components.
- Implement data ingestion, transformation, validation, reconciliation, and publishing processes across enterprise data platforms.
- Perform performance tuning of PySpark and SQL workloads by optimizing joins, partitioning, caching, file sizing, indexing, and query execution plans.
- Optimize Big Data jobs and distributed workloads by tuning Spark configurations, partitions, memory usage, execution plans, storage formats, and cluster resource utilization.
- Develop reusable frameworks for metadata-driven ingestion, incremental loads, error handling, audit logging, and data quality checks.
- Support unit testing, system testing, UAT, deployment, production monitoring, incident resolution, and post-production support.
- Collaborate with architects, business analysts, QA teams, DevOps teams, platform teams, and client stakeholders to deliver robust data solutions.
- Ensure compliance with data governance, security, lineage, audit, access control, and operational standards.
- Mentor junior data engineers, review code, provide technical guidance, and promote engineering best practices.
Skills
PySparkSpark SQLPythonSQLAzure Synapse AnalyticsAzure Data Lake Storage Gen2Azure Data FactoryAzure DatabricksAzure SQL DatabaseApache SparkHadoopHDFSHiveKafkaSqoopHBasedistributed data processingdata pipeline developmentdata engineeringbig data platformscloud data solutionsenterprise data processingAzure Synapse AnalyticsAzure Data Lake Storage Gen2Azure Data FactoryAzure DatabricksAzure SQL DatabaseApache SparkHadoopHDFSHiveKafkaSqoopHBase
Full description
CognizantCompany details are for members
Sign up for a free job alert to see Cognizant's profile, website and LinkedIn, and the same for every employer on Referso Jobs.