Large-scale data processing jobs

Own end-to-end engineering delivery, from design through implementation, testing, and production reliability.
Provide deep technical leadership, design reviews, and guidance on performance, scalability, security, and system tradeoffs, including accelerated computing where relevant; partner with senior architects to turn technical direction into robust products.
Translate product priorities and customer commitments into realistic engineering plans with clear owners, milestones, dependencies, quality gates, and measurable outcomes.
Build a disciplined execution culture with high engineering velocity, transparent progress, timely decisions, and accountability for commitments.
Recruit, coach, and retain exceptional engineers and engineering leaders; define team structures, clarify decision rights, develop successors, and raise the technical bar.

Skills

GPU computing CUDA PyTorch TensorFlow

Senior Manager, Software Engineering (Geospatial Platform)

Anduril Industries · Posted Nov 6, 2026

Open

Seattle, Washington, United States
Full-time · Manager
$220K–$292K per year
8+ years

Apply with RefersoAI Apply on careers page

Lead and grow the Terra geospatial platform team, set technical direction, and own production systems for autonomous military operations.

Compensation

US Salary Range $220,000—$292,000 USD

Responsibilities

Lead, hire, and develop a team of software and GIS engineers
Own the delivery and reliability of Terra’s production systems
Set the roadmap for Anduril’s common map environment
Work with business lines to understand mission needs and turn requests into products
Own Terra’s map content strategy and enforce data licensing

Requirements

Nice to have: mapping or imagery products to external users
Nice to have: offline, edge, or intermittently connected deployments
Nice to have: data vendor partnerships
Nice to have: content licensing
Nice to have: simulation

Skills

Go Python Kubernetes AWS Azure GDAL

Senior Software Development Engineer, AWS Marketplace & Partner Services

Amazon · Posted Nov 6, 2026

Open

Seattle, Washington, United States
On-site
Full-time · Senior
$168K–$227K per year
5+ years

Apply with RefersoAI Apply on careers page

Lead design and delivery of foundational data and AI/ML frameworks for AWS Marketplace, mentoring engineers and shaping technical direction.

Compensation

USA, WA, Seattle - 168,100.00 - 227,400.00 USD annually

Responsibilities

Design, build, and operate foundational data and AI/ML frameworks
Own significant components end-to-end for customer-facing intelligence
Lead technical direction and influence design across partner teams
Partner with Data Engineering, Research Science, and Applied Science teams
Mentor other engineers and sharpen technical judgment

Requirements

Bachelor's degree in computer science
Nice to have: full software development life cycle
Nice to have: coding standards
Nice to have: code reviews
Nice to have: source control

Skills

software development distributed systems large-scale data processing data pipelines semantic layers

Data Architect Senior

PNC · Posted Oct 27, 2026

Open

Cleveland, Ohio, United States +1 more
On-site
Full-time · Senior
$112K–$229K per year
8+ years

Apply with RefersoAI Apply on careers page

Senior Data Architect responsible for defining, governing, and evolving the Asset Management Group data architecture across analytical, operational, and digital domains.

Locations (2)

Cleveland, Ohio, United States
Pittsburgh, Pennsylvania, United States

Compensation

Base Salary: $112,000.00 – $228,800.00

Responsibilities

Define and maintain target-state architecture for domain analytical and operational data platforms
Lead architecture efforts to evolve legacy data platforms toward modern lakehouse and open-data architectures
Define migration strategies for existing Hadoop-based analytical environments and data workloads
Evaluate emerging technologies and industry trends to improve scalability, interoperability, operational efficiency, and long-term sustainability
Drive adoption of modern data management practices, storage architectures, metadata strategies, and platform operating models

Sr Director, Software Engineer

NetApp, Inc. · Posted Nov 6, 2026

Open

San Jose, California, United States
Senior
$266K–$396K per year

Apply with RefersoAI Apply on careers page

Lead the engineering organization responsible for defining, building, and delivering complex data and AI infrastructure software.

Compensation

The target salary range for this position is 266,050 - 396,000 USD.

Responsibilities

Own end-to-end engineering delivery, from design through implementation, testing, and production reliability.
Provide deep technical leadership, design reviews, and guidance on performance, scalability, security, and system tradeoffs.
Translate product priorities and customer commitments into realistic engineering plans with clear owners, milestones, dependencies, quality gates, and measurable outcomes.
Build a disciplined execution culture with high engineering velocity, transparent progress, timely decisions, and accountability for commitments.
Recruit, coach, and retain exceptional engineers and engineering leaders; define team structures, clarify decision rights, develop successors, and raise the technical bar.

Requirements

Nice to have: storage/data platforms
Nice to have: AI infrastructure
Nice to have: large-scale ML systems

Skills

GPU computing CUDA PyTorch

Senior AI Engineer, Big Data & AI Solutions

Mastercard · Posted Oct 27, 2026

Open

Vancouver, British Columbia, Canada
Senior
CA$111K–CA$160K per year

Apply with RefersoAI Apply on careers page

Senior AI Engineer, Big Data & AI Solutions

Compensation

Vancouver, Canada: $111,000 - $160,000 CAD

Responsibilities

Support machine learning models that help detect cyber-attacks, fraud and improve decision intelligence.
Create data pipelines and feature engineering workflows that enable model development and evaluation.
Process and analyze large-scale datasets to uncover insights and improve model inputs.
Strengthen monitoring, observability, and drift detection capabilities across production environments.
Apply automation and MLOps practices to improve reliability, efficiency, and scalability.

Requirements

Master’s degree with relevant experience
Bachelor’s degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, Engineering, or a related field
Nice to have: Fraud
Nice to have: cybersecurity
Nice to have: payments

Skills

Python PySpark SQL distributed data processing

Senior Software Engineer, Machine Learning, Discover Interest Modeling and Retrieval

Google · Posted Nov 4, 2026

Open

Mountain View, California, United States
On-site
Full-time · Senior
$174K–$252K per year
5+ years

Apply with RefersoAI Apply on careers page

The role involves developing representation learning models for Google's Discover personalized interest feed, focusing on retrieval, pre-ranking stacks, and personalization signals at a massive scale.

Compensation

US: $174000 - $252000 (USD) + 15% bonus target + equity + benefits

Responsibilities

Write and test product or system development code.
Develop representation learning models, including embedding or encoder models trained with contrastive, supervised, or self-supervised (e.g., masked-prediction) objectives, and set or sequence encoders (attention pooling, Transformers).
Execute clustering or metric learning at scale (e.g., hierarchical/agglomerative, density-based), and assess cluster quality.
Utilize Large Language Model (LLMs) in ML systems (e.g., LLM embeddings, autoraters for evaluation) and distill LLM judgments into classifiers.

Requirements

Bachelor’s degree or equivalent practical experience
Master's degree or PhD in Computer Science or related technical field
Nice to have: data structures
Nice to have: algorithms
Nice to have: technical leadership

Skills

Machine Learning models recommendation systems

Sr. Software Engineer - Investor Solutions

Addepar · Posted Nov 3, 2026

Open

Remote, United States
Remote
Full-time · Senior
$134K–$209K per year
5+ years

Apply with RefersoAI Apply on careers page

Senior Software Engineer to design, build, and optimize next-generation Research Platform for investment professionals.

Compensation

$134,000—$209,000 USD

Responsibilities

Work across the stack, including Python, Databricks, Java, and web technologies
Take projects through the full software lifecycle: design, architecture, prototyping, development, release, iteration, and monitoring
Build new systems and improve existing ones, from small fixes to large projects
Partner with researchers and product managers to shape the platform’s direction
Share knowledge through design reviews, code reviews, and mentoring

Skills

Python Java Databricks Spark web application development large-scale data processing production systems

See full job description

Large-scale data processing jobs

Compensation

Responsibilities

Requirements

Skills

Benefits

Compensation

Responsibilities

Skills

Compensation

Responsibilities

Requirements

Skills

Compensation

Responsibilities

Requirements

Skills

Locations (2)

Compensation

Responsibilities

Compensation

Responsibilities

Requirements

Skills

Compensation

Responsibilities

Requirements

Skills

Compensation

Responsibilities

Requirements

Skills

Compensation

Responsibilities

Skills

Benefits

Benefits

Requirements

Skills

Benefits

Benefits

Benefits