Big data platforms jobs

Software Engineering Manager

Microsoft · Posted Nov 12, 2026

Open

Redmond, Washington, United States
Full-time · Manager
$143K–$275K per year
10+ years

Software Engineering Manager

Microsoft · Posted Nov 12, 2026

Open

Redmond, Washington, United States
Full-time · Manager
$143K–$275K per year
10+ years

Principal Software Engineer

Microsoft · Posted Nov 12, 2026

Open

Redmond, Washington, United States
On-site
Full-time · Principal
$143K–$304K per year
6+ years

Apply with RefersoAI Apply on careers page

A deeply technical Principal Software Engineer who combines exceptional engineering judgment with a drive for results, providing technical leadership within Microsoft Purview Insider Risk Management (IRM) across high-throughput, multi-tenant cloud services, large-scale distributed data processing systems, and AI-powered capabilities.

Compensation

The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.

Responsibilities

Set technical direction for complex, high-scale systems
Lead complex initiatives across team boundaries
Raise the engineering bar across architecture, design, implementation, testing, deployment, security, reliability, performance, and maintainability
Solve systemic engineering problems
Multiply the impact of other engineers through mentoring and coaching

Requirements

Bachelor's Degree in Computer Science or related technical discipline

Skills

Distributed systems Cloud services Large-scale data processing Storage

Software Development Engineer, Close Systems - Project Accounting

Amazon · Posted Nov 12, 2026

Open

Dallas, Texas, United States
On-site
Full-time
$144K–$194K per year
3+ years

Apply with RefersoAI Apply on careers page

Build and operate large‑scale financial systems for Amazon Finance Technology

Compensation

USA, TX, Dallas - 143,700.00 - 194,400.00 USD annually

Responsibilities

Experience with large scale distributed systems and service oriented architecture
Experience building or supporting Financial Systems
Experience working with big data platforms
Experience with Amazon Web Services
Experience with Agile software development methodologies

Requirements

Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field
Nice to have: full software development life cycle
Nice to have: coding standards
Nice to have: code reviews
Nice to have: source control management

Skills

Java Python Lambda DynamoDB Athena EMR

Service Architect

Ericsson · Posted Nov 11, 2026

Open

Noida, Uttar Pradesh, India
5+ years

Apply with RefersoAI Apply on careers page

Design and develop high‑level, end‑to‑end architectures for Automation, Analytics and AI/ML (AAA) solutions that align with business objectives and customer needs.

Responsibilities

Lead design and develop high‑level, end‑to‑end architectures for Automation, Analytics and AI/ML (AAA) solutions
Translate business and customer requirements into technical solutions, perform use‑case requirement analysis and identify opportunities to aggregate scenarios for efficient infrastructure utilization
Create scalable, modular, and reusable reference designs and frameworks to streamline repetitive tasks, orchestrate workflows and enable automated decision‑making
Define success criteria, validation techniques and ensure repeatability of results across environments; contribute AAA features to roadmaps and EOE objectives
Collaborate with cross‑functional teams to ensure solution feasibility, optimize analytics workflows and enable operational automation

Requirements

Degree in Engineering (ECE/CSE/IT) or equivalent
MBA or advanced degree

Skills

architectural design capabilities for AAA scripting (Python, Shell, Perl)cloud platforms and services

Staff, Data Scientist – AI Agent Platform

Walmart · Posted Nov 11, 2026

Open

Bangalore, Karnataka, India +1 more
Staff
8+ years

Apply with RefersoAI Apply on careers page

Lead the next evolution of the AI assistant platform by defining and building highly scalable Generative AI systems and infrastructure.

Locations (2)

Bangalore, Karnataka, India
Chennai, Tamil Nadu, India

Responsibilities

Own the technical roadmap and architecture for multiple initiatives within the Conversational AI platform
Partner with key business stakeholders and be a thought leader in the Conversational AI space
Translate business requirements into strategies, initiatives, and projects
Align these with business strategy and objectives
Drive the execution of the deliverables

Requirements

Master's with 8+ years or Ph.D. with 6+ years of relevant experience in Computer Science/Statistics/Mathematics or related area

Skills

machine learning

Senior Azure Data Engineer

Cognizant · Posted Nov 13, 2026

Open

Senior
3+ years

Apply with RefersoAI Apply on careers page

Design, develop, and maintain scalable data pipelines and Big Data solutions on Microsoft Azure and related platforms.

Responsibilities

Design, develop, and maintain scalable data pipelines using PySpark, Spark SQL, Python, SQL, and Azure Synapse Analytics.
Build and optimize ETL/ELT workflows for large-volume structured, semi-structured, and unstructured data processing.
Develop and support Azure Synapse pipelines, notebooks, SQL scripts, stored procedures, views, and data transformation logic.
Work with Azure Data Lake Storage Gen2, Azure Data Factory, Azure Databricks, Azure SQL Database, and related Azure data services.
Develop and support Big Data solutions using technologies such as Apache Spark, Hadoop, HDFS, Hive, Sqoop, Kafka, HBase, and related distributed data processing components.

Skills

PySpark Spark SQL Python SQL Azure Synapse Analytics Azure Data Lake Storage Gen2 Azure Data Factory

Email Security Research Manager (Cortex - XDR)

Palo Alto Networks · Posted Jul 23, 2026

Open

Tel Aviv, Tel Aviv, Israel
On-site
Manager
8+ years

Apply with RefersoAI Apply on careers page

As an innovator at heart, you will lead the Email Security Research team and shape the future of AI-driven email protection. You will define the technical vision, drive the research roadmap, and lead a team developing advanced detection capabilities.

Responsibilities

Lead, mentor, and grow a team of Email Security researchers and analysts.
Define and execute the Email Security research, detection, and analytics roadmap.
Drive innovation in AI and LLM-powered email security.
Lead the design of advanced detections for phishing, Business Email Compromise (BEC), malware, account takeover, and emerging email threats.
Improve detection efficacy through behavioral analytics, threat research, and large-scale data analysis.

Requirements

Nice to have: AI
Nice to have: machine learning
Nice to have: LLM
Nice to have: big data platforms
Nice to have: GCP/BigQuery

Skills

Python SQL large-scale data analysis AI machine learning LLM

Summer 2027 Software Engineering Internship

T-Mobile · Posted Nov 6, 2026

Open

Overland Park, Kansas, United States
On-site
Internship · Intern
$27–$50 per hour

Apply with RefersoAI Apply on careers page

This is an 11-week paid learning experience where you’ll do real work, building voice, chat, and other customer care applications to support front-line teams.

Compensation

Intern wages range from $27/hour to $50/hour.

Responsibilities

Application Testing and Application Deployment
Develop and implement software solutions to meet customer requirements and support scalable, highly available environments
Maintain clear and accurate documentation for software code, system designs, and business requirements
Collaborate with technical teams to deliver software solutions and communicate technical ideas effectively
Contribute to the understanding and application of current and emerging technologies to support business goals

Requirements

Bachelors degree
Graduate degree

Skills

virtualization microservices software-defined networking network functions virtualization big data platforms

Senior Architect – Data Engineering (Databricks)

Object Edge · Posted Nov 6, 2026

Open

Navi Mumbai, Maharashtra, India
Full-time · Senior
10+ years

Apply with RefersoAI Apply on careers page

A visionary leader in the Databricks practice who drives strategic initiatives, fosters innovation, and tackles complex data challenges for clients using deep data architecture design and data engineering expertise.

Responsibilities

Collaborate closely with data leaders to drive sales, recruiting, account management, and operational excellence across the practice
Be part of our growing Databricks Center of Excellence and focus on leading on Databricks projects
Act as a Databricks SME, supporting business development efforts and guiding clients through best practices in architecture, data engineering, and scalable analytics
Drive innovation and performance through a team-based approach that values output, ownership, and employee wellbeing
Lead and manage project risk—including planning, budgeting, deliverables, and executive-level alignment

Requirements

Nice to have: Databricks Data Engineering Professional certification

Skills

Data engineering Data architecture Databricks Delta Lake Delta Live Tables

Big data platforms jobs

Compensation

Responsibilities

Requirements

Skills

Compensation

Responsibilities

Requirements

Skills

Compensation

Responsibilities

Requirements

Skills

Responsibilities

Requirements

Skills

Locations (2)

Responsibilities

Requirements

Skills

Responsibilities

Skills

Responsibilities

Requirements

Skills

Compensation

Responsibilities

Requirements

Skills

Responsibilities

Requirements

Skills

Benefits

Benefits

Benefits

Benefits