Lead Center of Excellence (COE) initiatives focusing on advanced data engineering and integration solutions using Snowflake and SnapLogic.
Responsibilities
Design and implement complex data pipelines using SnapLogic to facilitate seamless integration across diverse systems.
Develop and optimize data models and transformations within the Snowflake environment, leveraging Data Build Tool (DBT) for efficient data warehousing.
Architect and maintain CI/CD workflows to automate the deployment of data solutions, ensuring reliability and speed in the delivery lifecycle.
Write and refine Python or Shell scripts to enhance automation capabilities and support custom data processing requirements.
Execute advanced SQL queries to analyze data structures, troubleshoot performance issues, and validate data integrity.
Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Responsibilities
Be an SME and collaborate/manage the team
Be responsible for team decisions
Engage with multiple teams and contribute on key decisions
Provide solutions to problems for immediate and multiple teams
Lead efforts to optimize data workflows and improve system performance
Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Responsibilities
Be an SME and collaborate/manage the team
Be responsible for team decisions
Engage with multiple teams and contribute on key decisions
Provide solutions to problems for immediate and multiple teams
Lead efforts to optimize data workflows and improve system performance
Design, develop and maintain data solutions for data generation, collection, and processing, including creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems.
Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Responsibilities
Be an SME and collaborate/manage the team
Be responsible for team decisions
Engage with multiple teams and contribute on key decisions
Provide solutions to problems for immediate and multiple teams
Lead efforts to optimize data workflows and improve system performance
Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Responsibilities
Be an SME and collaborate/manage the team
Responsible for team decisions
Engage with multiple teams and contribute on key decisions
Provide solutions to problems for immediate and multiple teams
Lead the design and implementation of scalable data architectures
As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. This role includes creating efficient data pipelines, ensuring the accuracy and consistency of data, and implementing processes to extract, transform, and load data across various systems.
Responsibilities
Perform independently and become an SME
Active participation/contribution in team discussions
Contribute in providing solutions to work related problems
Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions
Monitor and troubleshoot data pipeline issues to maintain data integrity and availability
Design, develop and maintain data solutions for data generation, collection, and processing, including creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems.
Responsibilities
Design and develop data pipelines
Ensure data quality and integrity
Implement ETL processes
Collaborate with cross-functional teams to understand data requirements
Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Responsibilities
Be an SME, collaborate and manage the team to perform
Responsible for team decisions
Engage with multiple teams and contribute on key decisions
Provide solutions to problems for their immediate team and across multiple teams
Lead efforts to optimize data workflows and improve system performance
Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Responsibilities
Be an SME and collaborate/manage the team
Be responsible for team decisions
Engage with multiple teams and contribute on key decisions
Provide solutions to problems for immediate and multiple teams
Lead efforts to optimize data workflows and improve system performance