Provide hands‑on expertise in designing, delivering and supporting reliable, secure, scalable and cost‑conscious data solutions across COFCO International as a senior/specialist contributor within the Data Engineering team.
Responsibilities
Deliver assigned engineering and support work; contribute to prioritization and estimates, mentor engineers and coordinate contributors on specific technical initiatives.
Translate business and data requirements into technical designs, development estimates and delivery plans; communicate dependencies, risks and decisions early.
Design, develop and maintain end‑to‑end ETL/ELT pipelines and data models across enterprise data‑lake and other business data solutions; remain hands‑on in coding, reviews and complex troubleshooting.
Guide Azure Data Factory and Azure Synapse delivery, including SQL, Spark‑based transformations, notebooks and pipeline orchestration; promote reusable patterns and maintainable technical documentation.
Deliver integrations between source systems, data platforms and downstream consumers, including secure tabular‑data extracts and file transfers; coordinate connectivity and access requirements with infrastructure and security teams.
Requirements
Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems or a related discipline, or equivalent relevant professional experience.
Seeking for a Data Scientist to design, manage, and optimize enterprise data pipelines, data warehouses, and analytics solutions within Microsoft Azure.
Responsibilities
Design, build, and maintain robust enterprise ETL/ELT pipelines using Azure Data Factory, Synapse Pipelines, or PL/SQL procedures.
Manage and optimize Azure Synapse Analytics (SQL and Spark pools) and Microsoft Fabric Lakehouse.
Develop, test, and tune complex SQL and PL/SQL scripts, stored procedures, packages, and functions to support data integration.
Collaborate with business users to define analytical goals and build Power BI-ready datasets.
Integrate AI and machine learning insights using Azure Machine Learning and Azure OpenAI Service.
Own the design and delivery of complex data platform components, lead technical standards, mentor engineers, and manage stakeholder expectations in a regulated financial services environment.
Build and operate Python-based data pipelines for AI model training, including OCR processing, data cleaning, and Azure storage management.
Compensation
Payrate: $92.00 - $98.00/hr.
Pay Transparency: The typical base pay for this role across the U.S. is: $92.00 - $98.00 /hour.
Responsibilities
Develop, maintain, and optimize Python pipelines for data ingestion, OCR processing, text extraction, cleaning, normalization, and deduplication.
Run and monitor large-scale batch processing jobs, investigate failures, and implement reliable retry and recovery mechanisms.
Build automated quality checks to identify missing or corrupted files, incomplete OCR outputs, duplicate content, formatting issues, and metadata inconsistencies.
Prepare training-ready datasets through filtering, text segmentation, tokenization, and conversion into agreed data formats.
Manage bulk uploads, downloads, and synchronization between local processing environments and Azure storage; verify transfer completeness and data integrity.
A T-shaped professional role focused on delivering data and analytical solutions on analytics and big data platforms, acting as a technical expert within an Agile/Scrum environment.
Locations (2)
Lincoln, Lincolnshire, United Kingdom
Huntingdon, Cambridgeshire, United Kingdom
Compensation
£43k - £50k, salary dependant on skills and experience
Responsibilities
Actively contribute to work estimation
Adopt and embed agile development and continuous improvement into team ways of working
Support the onboarding of new team members & coach other Data Engineers
Actively contribute to drafting and updating service policies, procedures, work instructions and guidance notes
As a BI Solution Architect/Dimensional Modeller, design robust, secure and supportable corporate data solutions
Senior Data Engineer in the Data Architecture team, responsible for designing, building and running data pipelines and platform components on Microsoft Fabric, leading workstreams, coaching engineers, and ensuring secure, reliable data for analytics and AI.
Responsibilities
Design, build and run data pipelines using Fabric Data Factory and Fabric Lakehouse
Own ingestion of data from core systems such as Workday, Dynamics 365, Business World and SharePoint
Design data structures in Fabric Warehouse and Lakehouse and deliver curated datasets for Power BI and other reporting
Build security, data classification and access controls into pipelines and review others' work
Redesign legacy ETL and ELT processes for Fabric and plan cut-over