- Lahore, Punjab, Pakistan
- Full-time · Staff
- 5–8 years
Own the engineering foundation that turns complex enterprise, operational and platform data into reliable, secure, discoverable assets for analytics, machine learning and Burq Intelligence.
Responsibilities
- Design resilient ingestion from enterprise customers and strategic partners using APIs, webhooks, SFTP/file drops, CDC and scheduled exports as appropriate.
- Integrate OMS, WMS, TMS and FMS sources; normalize heterogeneous order, shipment, location, driver and provider records into documented contracts.
- Define schema evolution, idempotency, backfills, reconciliation, late-arriving data, retries, dead-letter handling and auditability.
- Build Snowflake ingestion and transformation patterns with clear SLAs and secure customer-specific isolation.
- Build and optimize batch and near-real-time pipelines using SQL, Python and suitable orchestration/stream-processing frameworks.
Requirements
- Nice to have: Snowpipe
- Nice to have: Streams/Tasks
- Nice to have: dynamic tables
- Nice to have: RBAC
- Nice to have: resource monitors