- Senior
Senior Data Engineer responsible for building and maintaining the data infrastructure to support business insights across the organization.
Responsibilities
- Develop and maintain data pipelines using MS Fabric
- Implement transformations using notebooks (Python, pyspark, sql)
- Experience with medallion data architecture
- Experience building a data lakehouse (data lake + delta tables)
- Work with various data sources, including CSVs, APIs, and automated activities
Requirements
- Nice to have: Familiarity with Delta tables
- Nice to have: Understanding of data partitioning
- Nice to have: Experience with Azure DevOps or GitHub
- Nice to have: Previous experience working with data volumes in the range of gigabytes to terabytes