Jobs Referso Partner API

Free job alerts

Spark optimization jobs

Job titleLocation

Popular:United States Canada Viet Nam

All filtersRefine by skill, company, date, job type, industry and more

Company

Skillsjobs that use all of them

Spark optimization

Popular

Date posted

Any timePast hourPast 24 hoursPast week

Workplace

RemoteHybridOn-site

Job type

Full-timePart-timeContractInternshipTemporary

Experienceyears required

0–2 years2–5 years5–10 years10+ years

Salary

Salary listed

Education

High schoolAssociate degreeBachelor's degreeProfessional certificatePostgraduate degree

Industryfield of work

Software & InternetHardware & ElectronicsEngineeringHealthcareLife Sciences & ResearchFinance & AccountingSales & Business DevelopmentMarketing & CommunicationsCreative & DesignCustomer Service & SupportAdministrative & OfficeHuman Resources & RecruitingLegal & ComplianceManagement & OperationsEducation & TrainingRetailHospitality & Food ServiceManufacturing & ProductionSkilled Trades & ConstructionTransportation & LogisticsFacilities, Cleaning & SecuritySocial Services & Public SectorEnergy, Environment & Agriculture

1 selected

Skill:Spark optimization

Referso Jobs

Fresh jobs from employer career sites in the US and Europe. Search free, get alerts free, and let Referso apply when you're ready.

Job seekersSearch jobs Free job alerts Remote jobs

RefersoAuto-apply How it works Pricing Log in

For companiesPartner API (beta)API docs Contact sales

CompanyAbout Contact Privacy Terms

© 2026 Referso. Jobs link to the original posting; Referso is not affiliated with the employers listed.Privacy Terms Request a removal

1–3 jobs· newest first

Senior Data Engineer (Databricks and Pyspark)New
Unison Group · Kuala Lumpur, Malaysia+1 more
Full-time · Senior
Senior Databricks Engineer (SQL, Python, PySpark)
APN Consulting Inc · Santa Clara, US
Senior
Senior Data Engineer
Penn Foster Group · Remote, US
Remote · Full-time · Senior

+10K new in the last hour

Senior Data Engineer (Databricks and Pyspark)

Unison Group · Posted Nov 5, 2026

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia +1 more
Full-time · Senior
5–8 years

Apply with Referso

AI

Apply on careers page

Senior Data Engineer role focused on Databricks, PySpark, Delta Lake, and cloud-based data pipelines, implementing Lakehouse/Medallion architectures.

Locations (2)

Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
Singapore, Singapore

Compensation

Full Time Perm role + one month Bonus

Responsibilities

Design, build, and optimize data ingestion and transformation pipelines using Databricks, PySpark, and Python.
Implement Delta Lake and Medallion architecture for scalable enterprise data platforms.
Develop ingestion frameworks for data from SFTP, REST APIs, SharePoint/Graph API, AWS, and Azure sources.
Automate workflows using Databricks Workflows, ADF, Azure Functions, and CI/CD pipelines.
Optimize Spark jobs for performance, reliability, and cost efficiency.

Requirements

Nice to have: Mandarin Language
Nice to have: Oil & Gas
Nice to have: trading analytics
Nice to have: SPARTA
Nice to have: KPLER

Skills

Databricks PySpark Delta Lake SQL Python Azure Data Lake ADF Azure Functions AWS S3 Lambda ETL/ELT Lakehouse/Medallion architecture Git Azure DevOps CI/CD YAML pipelines Spark optimization

Benefits

one month Bonus

See full job description

A

Senior Databricks Engineer (SQL, Python, PySpark)

APN Consulting Inc · Posted Nov 3, 2026

Santa Clara, California, United States
Senior
8+ years

Apply with RefersoAI Apply on careers page

Design, develop, and optimize large-scale data processing solutions using Databricks, PySpark, Python, and SQL.

Responsibilities

Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL.
Build and optimize ETL/ELT frameworks for processing large volumes of structured and unstructured data.
Develop data ingestion solutions from multiple source systems into cloud data lakes and warehouses.
Optimize Spark jobs for performance, scalability, and cost efficiency.
Collaborate with data architects, analysts, and business stakeholders to understand data requirements.

Requirements

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
Nice to have: Azure
Nice to have: AWS
Nice to have: GCP
Nice to have: Azure Data Factory

Skills

Databricks PySpark Python SQL Spark optimization data warehousing

Senior Data Engineer

Penn Foster Group · Posted Nov 3, 2026

Remote, United States
Remote
Full-time · Senior
6+ years

Apply with RefersoAI Apply on careers page

Senior Data Engineer responsible for architecting, building, and evolving Penn Foster Group’s modern cloud data platform and AI strategy.

Responsibilities

Architect and build scalable data pipelines
Mentor and develop engineering team
Establish engineering standards
Drive adoption of Databricks and Azure capabilities
Design and maintain semantic data products

Requirements

Bachelor's degree in Computer Science, Engineering, Information Systems, or related field
Nice to have: Databricks Genie
Nice to have: Genie Spaces
Nice to have: Genie Ontologies
Nice to have: Semantic Modeling

Skills

Databricks Lakehouse Platform Apache Spark (PySpark)Delta Lake Unity Catalog Databricks Workflows & Jobs Repos SQL Warehouses

dimensional modeling

ETL/ELT pipelines

Databricks workflows

Azure Data Factory

See full job description

Cluster Policies

Serverless Compute

Lakehouse Monitoring

Delta Live Tables / Lakeflow

Microsoft Azure

Medallion Architecture

Dimensional Modeling

Spark Optimization

CI/CD pipelines

Infrastructure as Code

Automated Testing

Data Governance

Metadata Management

Great Expectations

Benefits

Medical
Dental
Vision
Flexible Spending
Paid Time Off

See full job description