Data Engineer
The role focuses on designing and building data models, curated datasets and pipelines to support business intelligence, analytics and data science use cases.
- Singapore, Singapore
- Posted Jan 1, 2024
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics
Responsibilities
- Engage directly with business stakeholders to understand requirements and translate them into data models, datasets and pipelines
- Design and develop data models and transformation pipelines to integrate, clean, harmonise and curate data from multiple source systems
- Build and maintain scalable, reliable and reusable data pipelines using Databricks, Spark and SQL
- Design datasets and data structures optimized for downstream reporting, analytics and data science applications
- Implement data quality checks, validation and reconciliation to ensure data accuracy and consistency
- Monitor and troubleshoot pipeline performance and operational issues
- Document data models, datasets, transformations and pipeline dependencies
- Work with data engineers, analysts and data scientists to deliver data solutions aligned with business needs
Requirements
- Degree in Computer Science, Information Technology, Data Engineering or a related discipline
- Experience in a government
Nice to have: Databricks Workflows, Unity Catalog, Data governance, Access control, Data quality practices
Skills
Full description
User Experience Researchers Pte. Ltd.Company details are for members
Sign up for a free job alert to see User Experience Researchers Pte. Ltd.'s profile, website and LinkedIn, and the same for every employer on Referso Jobs.