Design, build, and evolve the shared ingestion platform that underpins data delivery across the company, focusing on reliability, extensibility, and adoption.
- Design and implement reusable ingestion components using dlt and dbt-core, covering both structured and unstructured data sources
- Own the Airflow platform end-to-end: extend and maintain DAGs and shared operators, handle deployments and version upgrades
- Ensure incremental loading strategies, data quality checks, and lineage metadata are first-class outputs
- Identify and eliminate redundant ingestion patterns across consuming teams, drive standardization onto shared Platform Foundation components
- Collaborate with Solution Architects to evolve the platform architecture
- Nice to have: GitHub Copilot
- Nice to have: Claude Code
- Nice to have: RAG pipelines
- Nice to have: LLM