- Remote, United States
- Remote
- Full-time · Senior
- $135K–$160K per year
- 5+ years
The Senior Data Engineer will play a key role in advancing McGraw Hill Education's (MHE) product eventing, data platforms, and analytics capabilities. This role focuses on designing scalable, reliable, and high-quality data solutions that transform learning interactions and product events into actionable learning insights.
Compensation
The pay range for this position is between $135,000 - $160,000 annually, however, base pay offered may vary depending on job-related knowledge, skills, experience, and location. An annual bonus plan may be provided as part of the compensation package, in addition to a full range of medical and/or other benefits, depending on the position offered.
Responsibilities
- Work closely with product platform teams to define and create meaningful learning events, establish event standards, and build scalable, reliable event pipelines that connect learning interactions to actionable learning insights.
- Design, develop, and optimize parallel and distributed ETL/ELT pipelines using Apache Spark (PySpark/Scala) and Databricks.
- Build and maintain real-time and near-real-time event-driven data pipelines that support the ingestion, processing, and transformation of product and learning interactions.
- Establish and maintain end-to-end data quality across event schemas, ingestion pipelines, transformations, and curated data products.
- Develop and maintain Databricks Workflows, including dependency management, retry policies, scheduling, monitoring, and alerting.
Requirements
- Nice to have: Databricks Workflows
- Nice to have: Infrastructure-as-code