Cloud Data Engineer
Results-driven Data Engineer with expertise in designing, building, and optimizing scalable data pipelines across cloud and distributed systems. Skilled in Python, PySpark, and SQL for data ingestion, transformation, and integration.
- $80K–$90K per year
- Posted Mar 11, 2026
INDUSTRYSoftware & InternetData & AnalyticsCloud & DevOps
Responsibilities
- Build and maintain scalable data pipelines using cloud services for ingestion, transformation, and storage.
- Develop data products that integrate customer data from multiple sources into unified profiles.
- Create metadata-driven frameworks to ensure data quality, consistency, and governance.
- Write Pyspark, and Spark SQL scripts to perform complex data transformations, ensuring data pipelines are efficient, scalable, and optimized for analytics and reporting.
- Support ETL processes by fixing errors, improving resiliency, and ensuring data integrity across reports and dashboards.
- Monitor data platforms, respond to alerts, and optimize pipelines for efficiency and cost reduction.
- Perform root cause analysis (RCA) for job failures and ensure stability after releases.
- Collaborate with onsite and offshore teams to coordinate tasks, align processes, and deliver projects smoothly.
- Participate in design reviews, implementation walkthroughs, and production deployments.
- Apply governance best practices to maintain security, lineage, and compliance with organizational and regulatory standards.
- Work closely with stakeholders and architects to capture requirements and deliver reliable solutions.
- Use Atlassian tools (Jira, Confluence, Bitbucket) for project management, documentation, and collaboration.
- Lead projects through effective planning, prioritization, and team coordination to ensure successful delivery.
Requirements
- Databricks Certified Data Engineer Associate
- Experience in a Banking (BFSI)
Skills
Azure Data Lake Storage (ADLS)Azure Blob StorageHadoop (HDFS, Hive)PySparkSQL ServerAzureAWSGitBitbucketCI/CDShell ScriptingJIRAAgile ScrumControl-MSterling B2B IntegratorPostmanAPI TestingPyCharmVS CodeSpark LogsBanking (BFSI)AzureAWSGitBitbucketJiraConfluenceControl-MSterling B2B IntegratorPostmanPyCharmVS Code
Full description
CognizantCompany details are for members
Sign up for a free job alert to see Cognizant's profile, website and LinkedIn, and the same for every employer on Referso Jobs.