Staff Data Platform Engineer
The Data Platform Engineering Team acts as the backbone of our enterprise data architecture, bridging the gap between Data Engineering, Infrastructure, and Operations. Responsible for architecting, scaling, and maintaining multi-cloud infrastructure across AWS and Azure, the team takes direct ownership of core Apache Airflow orchestration, big data frameworks, and containerized environments to ensure a robust, production-grade platform.
- Remote, United States
- Full-time
- Remote
- $141K–$173K per year
- Posted Oct 9, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareData & Analytics
Responsibilities
- Design, deploy, scale, and maintain highly available Apache Airflow clusters (using Helm, Kubernetes, and Terraform) to support critical enterprise ETL/ELT workflows.
- Drive DevOps practices using Terraform, Helm Charts, and ArgoCD to automate platform deployments, manage self-hosted GitHub runners, and enforce GitOps workflows.
- Architect and manage robust CI/CD pipelines utilizing GitHub Actions for seamless deployment of data pipelines, infrastructure components, and DAGs.
- Provision and manage scalable Kubernetes (EKS/AKS) clusters, Docker containers, and underlying cloud infrastructure across AWS (EC2, EMR, S3, VPC) and Azure (Synapse, ADLS).
- Build and maintain end-to-end monitoring, logging, and alerting systems using Grafana, Prometheus, Loki, and centralized log management solutions to ensure high platform uptime and reliability.
- Build scalable data infrastructure supporting big data processing engines and data warehouses, including Apache Spark, AWS EMR, Snowflake, Azure Synapse, Apache Kafka, and dbt.
- Deploy and maintain central data discovery and metadata tooling (e.g., DataHub) to facilitate data governance, schema management, and cataloging.
- Actively monitor, audit, and optimize data infrastructure compute and storage costs across AWS and Azure (EC2, EMR, Snowflake queries, Kubernetes nodes).
- Build internal tools, CLI utilities, and dynamic workflow templates to improve developer productivity for data engineers, analytics engineers, and data scientists.
- Take full technical ownership of data platform modules from architectural design through deployment, production operations, and incident management.
- Define and enforce high engineering standards for code quality, design patterns, testing, data lineage, and security (access controls, IAM, dynamic schema management).
- Partner with data leads, product managers, and business stakeholders to identify infrastructure gaps, define a 1–2 year data platform roadmap, and prioritize platform initiatives.
- Serve as a subject matter expert (SME) on data infrastructure, guiding and mentoring junior and mid-level data platform engineers.
Requirements
- Experience in a Big Data
- Experience in a DevOps
- Experience in a Site Reliability Engineering
Nice to have: DataHub, Amundsen
Skills
Apache AirflowKubernetesHelmTerraformDockerArgoCDGitHub ActionsGrafanaPrometheusLokiApache SparkAWS EMRSnowflakeAzure SynapseApache KafkadbtAWSAzurePythonBashGoSQLAWSAzureEC2S3VPCIAMEKSAKSSynapseADLS
Benefits
- health insurance
- dental and vision insurances
- retirement savings plan
- paid time off
- health savings account
- flexible spending accounts
- life insurance
- disability insurance
- tuition reimbursement
More jobs nearby
Full description
Company details are for members
Sign up for a free job alert to see WEX's profile, website and LinkedIn, and the same for every employer on Referso Jobs.