Back to search

USA_Developer

Design, develop, and optimize scalable data pipelines and cloud-based data solutions using Azure services.

  • Minnetonka Mills, Minnesota, United States
  • $53–$57 per hour
  • Posted Nov 10, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software

Responsibilities

  • Design and develop scalable data pipelines
  • Optimize performance of data processing workflows
  • Implement ETL/ELT processing and data governance
  • Build and maintain REST or GraphQL APIs
  • Deploy APIs on Kubernetes (AKS)
  • Ensure API security and contract compliance

Requirements

Nice to have: AI/LLM frameworks, Databricks AI/ML, Codex, Claude

Skills

Azure DatabricksPySparkAzure Data FactoryDelta LakeUnity CatalogPythonSQLGitHubCI/CDREST APIsGraphQL APIsKubernetesAPI securitydata governancesecurity

More jobs nearby

Full description

Pay Rate Range: $53.03 - 56.81/hr. Job Description: seeking a Data Engineer with strong hands-on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions, with expertise in ETL/ELT processing, data modeling, performance tuning, and data governance. The role requires proficiency in Python, SQL, GitHub, and CI/CD practices, along with experience working with large-scale datasets in enterprise environments. This is an individual contributor role that demands strong analytical and problem-solving skills, the ability to work independently, and ownership of end-to-end solution delivery while collaborating effectively with cross-functional teams and business stakeholders. Expertise in: Azure Databricks, PySpark, Delta Lake Azure Data Factory (ADF) and ADLS Gen2 Experience working on large-scale, cloud-native data platforms (Azure preferred) Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.) Strong experience building REST or GraphQL APIs Experience with Kubernetes (AKS preferred) for API deployment Understanding of API security, contracts, error handling, and performance Strong understanding of data governance, security, and CI/CD practicesPrimary skill for the API Role with AI Builder Essential Skills: Associate should have handson knowledge in Databricks| ADF| pyspark| Also must have knowledge of cloud Skills: Digital : Scala~Digital : Databricks~Digital : PySpark~Azure Data Factory Experience Required: 4-6 years Skills: Category Name Required Importance Experience SkillCategoryTest1_MN Azure Data Factory Yes 1 >7 years SkillCategoryTest1_MN Databricks Yes 1 >7 years SkillCategoryTest1_MN Digital : Azure Databricks Yes 1 >7 years SkillCategoryTest1_MN Digital : PySpark Yes 1 >7 years SkillCategoryTest1_MN Digital : Scala Yes 1 >7 years

USA_Developer at Varite, Inc | Referso Jobs