Data Engineer
Promevo, LLC · Posted Jan 1, 2024
- Remote
- Remote
- Full-time · Mid
- 4+ years
Design, build, and optimize modern, enterprise-grade data pipelines and AI infrastructure across client environments, supporting AI-driven data engineering initiatives.
Compensation
Competitive salary and bonus plan
Responsibilities
- Design, construct, and maintain scalable batch and streaming data pipelines on Google Cloud Platform (GCP) using BigQuery, Dataflow, Dataproc, and Pub/Sub to support real-time analytics and generative AI workloads.
- Implement BigQuery Agent Analytics telemetry architecture following medallion conventions (raw, processed, curated datasets) to export and curate agent interaction telemetry, latency metrics, and error rates.
- Build and optimize grounding data integrations between enterprise data repositories (e.g., BigQuery, external storage) and high-code Agent Development Kit (ADK) agents on Google Cloud Agent Runtime.
- Develop reusable reference connector patterns, dbt/LookML models, and automated orchestration workflows (Cloud Composer / Apache Airflow) to accelerate client onboarding and data modeling timelines.
- Configure Agent Observability integrations with BigQuery, Cloud Logging, and Cloud Monitoring to maintain operational health dashboards and service level objectives (SLOs).
Requirements
- Bachelor's degree in Computer Science
- Bachelor's degree in Data Engineering
- Bachelor's degree in Information Systems