Duration: 12 months
Schedule: 8:00 AM – 5:00 PM CST
Job Description:
The main function of the Data Engineer is to develop, evaluate, test and maintain architectures and data solutions within our organization. The typical Data Engineer executes plans, policies, and practices that control, protect, deliver, and enhance the value of the organization's data assets.
Responsibilities:
Should be able to design complex and high performance Data architecture
Developing and maintaining strong relations with senior executives—developing new insights into the client’s business model and pain points, and delivering actionable, high-impact results
Participating and leading key engagements, in developing plans and strategies of data management processes and IT programs for the business, providing hands on assistance in data modeling, technical implementation of big data solutions
Facilitating, guiding, and influencing the clients and teams towards right information technology architecture and becoming interface between Business leadership, Tech leadership and the delivery teams
Leading and mentoring other developers within the team
Identify the performance bottle-necks and resolve the same
Ability to produce high quality work products under pressure and within deadlines
To coordinate with developers / other architects / other stakeholders and cross functional teams from organization
Skillsets:
5-7 years of experience in designing and implementing large scale data processing/data storage/data distribution systems
Any combination of below technical skills
Hadoop : HDFS, MapReduce, Hive, Airflow
DW : BigQuery, Hive
Languages : Python, PySpark, Shell Scripting, SQL Scripting
Cloud : GCP Big data native services
Any RDBMS/DWBI technologies
Spark(Mandatory): Spark on GCP Dataproc
Extensive experience working with large data sets with hands-on technology skills to design and build robust Big Data solutions using Spark framework, GCP Big data services and industry standard frameworks
Ability to work with a multi-technology/cross-functional teams and key stakeholders to guide/manage a full life-cycle solution
Extensive experience in Relational and MPP database platforms like (GCP Bigquery/Hive/Cloud SQL etc)
Open source Hadoop stack/Spark framework
Strong understanding of Big Data Analytics platforms and ETL in the context of Big Data
Excellent problem solving, hands-on engineering skills and communication skills
Broad understanding and experience of real-time analytics
Participate in full Software Development Life Cycle (SDLC) of the Big Data Solution
Process certification, such as, Six Sigma, CBPP, BPM, ISO 20000, ITIL, CMMI.
Education:
Bachelor's degree in a technical field such as computer science, computer engineering or related field required.
About US Tech Solutions:
US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.
US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
AI Statement: By applying, you acknowledge that AI-assisted tools may be used during hiring.
#LI-BP1
IND01