Data Engineer

The Data Engineer will build, test, and maintain large-scale batch and real-time data pipelines using frameworks like PySpark and Spark, ensuring data quality and driving technical solutions.

Pune, Maharashtra, India
Full-time
On-site
Posted Nov 6, 2026

INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics

Apply with RefersoAI Apply on careers page

Responsibilities

Data Mining from structured, semi-structure & unstructured data sources
Implement data flows and set up automation between various data sources
Help in building large-scale batch and real-time data pipelines with data processing frameworks like PySpark and Spark
Ensure data quality, interpret & analyse the data problems
Develop, construct, test and maintain pipelines
Maintain data documentation and definitions
Perform feasibility studies to drive the business users toward the best technical solutions
Contribute to functional analysis with the business users and translate user’s needs into structured Data Pipelines
Prepare data for predictive and prescriptive modelling and Develop data set processes
Elaborate solution mock-up in agile manner together with the business users
Develop and test each solution component toward its industrialization
Contribute to the evolution of the Data platform, elaborate system improvements, design innovative solutions
Work with Agile and DevOps techniques to deliver solutions in a timely manner
Keep constant track of new tools and potential obsolete ones through a technological watch
Contribute to use cases industrialization initiatives and actions plan
Share expertise with other team members to facilitate knowledge transfer, lead internal investment projects
Communicate across departments and understand what drives the requirements of the functional leaders, business team
Collaborate well with others including considering others’ perspectives on methodologies and technologies

Requirements

Bachelors/s degree in computer science engineering
Master’s degree in computer science engineering
Experience in a IT consulting
Experience in a Cloud computing

Nice to have: Big Data solutions, BI & Big Data tools, IT & Cloud environments

Skills

Data MiningPySpark Spark PythonPL SQLSQLAgile Software DevelopmentPySpark Spark PythonPL SQLSQL

Benefits

Great Place to work certified

Full description

Give us an opportunity to find the next career move for you. SA Technologies Inc. is hiring for Data Engineer in Pune Requirement/Description: Experience : 3 to 5 Yrs · Data Mining from structured, semi-structure & unstructured data sources. · Implement data flows and set up automation between various data sources. · Help in building large-scale batch and real-time data pipelines with data processing frameworks like PySpark and Spark. · Ensure data quality, interpret & analyse the data problems. · Develop, construct, test and maintain pipelines. · Maintain data documentation and definitions. · Perform feasibility studies to drive the business users toward the best technical solutions · Contribute to functional analysis with the business users and translate user’s needs into structured “Data Pipelines” · Prepare data for predictive and prescriptive modelling and Develop data set processes · Elaborate solution mock-up in agile manner together with the business users · Develop and test each solution component toward its industrialization · Contribute to the evolution of the Data platform, elaborate system improvements, design innovative solutions, define best practices to ensure the platform remains sustainable · Work with Agile and DevOps techniques to deliver solutions in a timely manner · Keep constant track of new tools and potential obsolete ones through a technological watch · Contribute to use cases industrialization initiatives and actions plan · Share expertise with other team members to facilitate knowledge transfer, lead internal investment projects · Communicate across departments and understand what drives the requirements of the functional leaders, business team. · Collaborate well with others including considering others’ perspectives on methodologies and technologies Appreciated extra skills · Bachelors/master’s degree in computer science engineering. · Experience in Big Data solutions, with wide knowledge of BI & Big Data tools, and IT & Cloud environments. · Hands on experience on Pyspark/Pythonr · Good knowledge of PL SQL/SQL. · Knowledge on Agile Software Development methodologies · Curious and creative mind, able to turn data into compelling storylines · Excellent oral and written communication skills · Excellent problem solving and troubleshooting skills · Process oriented with great documentation skills · Fluent English (verbal and written) SA Technologies specializes in offering IT consulting and Development solutions for our global customers. From 20 years we have been helping our customers achieve operational excellence and compliance on the cloud. Our expertise lies in delivering quality services, cross-platform skills & supporting you to achieve operational excellence & empower you to become a technology-driven enterprise. We are Microsoft Gold Partner, Google Partner, and Great Place to work certified company.