- Toronto, Canada
- Hybrid
- Full-time · Senior
- 10+ years
Design and implement the end-to-end data platform for APEX, integrating call center telephony and quality data from the Genesys A3S Snowflake database and Verint Workforce Management (WFM) feeds.
Responsibilities
- Design and implement end-to-end Bronze/Silver/Gold data architecture for Genesys A3S Snowflake and Verint data sources, including data ingestion, transformation, validation, and consumption.
- Develop dimensional data models using Kimball principles, including star schemas, fact and dimension tables, grain definition, conformed dimensions, and SCD Type I/II, supporting sales, contact center telephony, agent activity, quality evaluations, and operational reporting.
- Build and optimize scalable data pipelines using Databricks, Delta Lake, Python, PySpark, Spark SQL, and T-SQL, applying incremental loading, watermarks, checkpoints, ACID transactions, partitioning, Z-ordering, and query optimization.
- Integrate Snowflake sources, vendor flat files, SFTP transfers, and REST APIs, implementing secure connectivity, pagination, rate-limit handling, asynchronous processing, schema evolution, data normalization, and source-to-target reconciliation.
- Establish data quality, integrity, and audit controls, including deduplication, referential integrity, row counts, checksum/hash comparisons, late-arriving data handling, and detection and remediation of missing records, data drift, and schema changes.