Climate Data Utility Tech Team - Senior Data Engineer
Senior Data Engineer to design, implement, enhance, and maintain scalable data pipelines for the Net-Zero Data Public Utility.
- London, England, United Kingdom
- Full-time
- Posted Jan 1, 2024
INDUSTRYSoftware & InternetSaaS & Enterprise Software
Responsibilities
- Design and develop scalable data pipelines using Python to read from APIs and structured files (Excel, Parquet)
- Translate domain and source specific business logic into efficient code implementations to turn source data into usable structured data for downstream applications
- Implement data transformations and structuring using tools like Pandas and Pydantic to ensure data quality, consistency, and adherence to business logic requirements
- Collaborate with data scientists and analysts to support data-driven decision-making
- Document data engineering processes, including data lineage, data dictionaries, and system architectures
- Maintain best practices through code reviews, version control, and adherence to industry standards
- Deploy production quality code through CI/CD pipelines into our cloud environment
- Provide mentorship and guidance to junior team members, fostering their growth and development in data engineering practices
Requirements
- Experience in a Climate Data
Skills
Full description
Company details are for members
Sign up for a free job alert to see Bloomberg's profile, website and LinkedIn, and the same for every employer on Referso Jobs.