Scalable data pipelines jobs

Custom Software Engineer

Accenture Infrastructure and Capital Projects, LLC · Posted Nov 10, 2026

Open

Hyderabad, Telangana, India
3+ years

Apply with RefersoAI

Custom Software Engineer

Accenture Infrastructure and Capital Projects, LLC · Posted Nov 10, 2026

Open

Hyderabad, Telangana, India
3+ years

Apply with RefersoAI

Agentic AI Engineer / Architect

SGA Inc. · Posted Nov 9, 2026

Open

Remote, United States
Remote
Contract
6+ years

Apply with RefersoAI Apply on careers page

Design, develop, and deploy intelligent agent systems for a Cyber Security organization, focusing on autonomous or semi-autonomous AI agents powered by large language models and RAG architectures.

Responsibilities

Assist with the creation of and support of AI capabilities in support of the Cyber Security Organization
Design, develop, and deploy intelligent agent systems that can reason, plan, and autonomously interact within complex environments
Design, build, and optimize autonomous or semi-autonomous AI agents powered by large language models (LLMs), retrieval-augmented generation (RAG), and tool-using frameworks
Architect systems for agent planning, memory, reflection, and recursive reasoning across multiple contexts or sessions
Evaluate and integrate frameworks such as LangGraph, CrewAI, AutoGen, or ReAct-style agents based on project needs

Requirements

Nice to have: autonomous agents
Nice to have: multi-agent coordination
Nice to have: simulation environments
Nice to have: enterprise APIs
Nice to have: secure environments

Skills

Python LangChain Hugging Face

AI / ML Engineer

Accenture Infrastructure and Capital Projects, LLC · Posted Nov 9, 2026

Open

Bengaluru, Karnataka, India
3+ years

Apply with RefersoAI Apply on careers page

Design and build advanced AI applications and systems, integrating generative AI models into cloud or on‑prem pipelines, and ensuring production‑ready quality.

Responsibilities

Design and implement scalable data pipelines and workflows
Integrate generative AI models into production environments
Collaborate with stakeholders to translate requirements into technical solutions
Monitor and optimize AI application performance
Provide guidance to junior team members

Requirements

15 years full time education

Skills

Data Engineering Scalable data pipelines Cloud platforms and AI services Generative AI model integration Data processing techniques Large dataset handling AI frameworks and tools

Senior Data Engineer

Partnerize · Posted Nov 5, 2026

Open

Tel Aviv, Tel Aviv, Israel
Senior

Apply with RefersoAI Apply on careers page

Design, build, and own highly scalable data pipelines and data infrastructure for Partnerize’s AI-driven products.

Responsibilities

Design, build, and own highly scalable data pipelines and data infrastructure
Process and analyze large-scale datasets from multiple digital sources and environments
Build reliable infrastructure and reusable components that enable Data Scientists and Product teams to develop and productionize data-driven capabilities
Design data architectures optimized for scalability, reliability, performance, and cost
Develop production-grade data processing systems handling high volumes of structured and unstructured data

Requirements

Nice to have: Machine Learning infrastructure
Nice to have: Digital advertising
Nice to have: Attribution
Nice to have: Marketing technology
Nice to have: Event-based data

Skills

Data Engineering Scalable data pipelines AWS Airflow Spark

Custom Software Engineering Lead

Accenture · Posted Nov 5, 2026

Open

Hyderabad, Telangana, India
5+ years

Apply with RefersoAI Apply on careers page

Own the technical direction and architecture of custom software solutions, leading teams through design and delivery.

Responsibilities

Own the technical direction and architecture of custom software solutions
Lead teams through design and delivery
Set development standards and ensure code quality, scalability, and performance
Collaborate with stakeholders to drive innovation and continuous improvement
Mentor and support team members to foster professional growth and technical excellence

Skills

Microsoft Azure Databricks cloud-based data engineering big data processing frameworks distributed computing scalable data pipelines performance tuning resource management in cloud environments integration with enterprise systems

Data Scientist - Senior

GRVTY · Posted Nov 5, 2026

Open

McLean, Virginia, United States
Senior
$120K–$160K per year

Apply with RefersoAI Apply on careers page

Senior Data Scientist supporting mission-driven analytics and modernization efforts across the Intelligence Community.

Compensation

The pay range for this position is: $120,000 - $160,000

Responsibilities

Develop advanced analytic solutions that transform complex intelligence data into actionable insights
Design and implement scalable data pipelines, automation strategies, and analytic processes
Build tools, automate manual processes, and develop reusable analytic capabilities
Create visualizations and dashboards to communicate findings to stakeholders
Prototype and deploy solutions to support evolving customer needs

Requirements

Nice to have: low-code/no-code platforms
Nice to have: machine learning
Nice to have: artificial intelligence
Nice to have: cloud-based data platforms
Nice to have: distributed computing

Skills

Python data modeling automation visualization dashboards

Custom Software Engineering Lead

Accenture · Posted Nov 5, 2026

Open

Hyderabad, Telangana, India
5+ years

Apply with RefersoAI Apply on careers page

Own the technical direction and architecture of custom software solutions, leading teams through design and delivery.

Responsibilities

Steer the technical vision and architectural framework for bespoke software projects
Guide teams through the entire lifecycle of software design and implementation
Ensure development practices meet high standards
Oversee scalability and performance of solutions
Foster collaboration and innovation within the team

Requirements

15 years full time education

Skills

Microsoft Azure Databricks cloud-based data engineering analytics platforms distributed computing big data processing frameworks scalable data pipelines data security and governance best practices

Senior Product Manager – Competitive Intelligence

Blackbuck Insights · Posted Nov 2, 2026

Open

Phoenix, Arizona, United States
Full-time · Senior
7+ years

Apply with RefersoAI Apply on careers page

Lead the Competitive Intelligence product suite, owning strategy, roadmap, and delivery in a fast‑paced SaaS environment.

Responsibilities

Own product strategy, roadmap, and end‑to‑end delivery of Competitive Intelligence capabilities
Drive product requirements for web scraping, automated data acquisition, data normalization, and scalable competitive data pipelines
Define and enhance product matching capabilities, including attribute‑based, fuzzy, semantic, and AI/ML‑driven matching
Develop scalable Data‑as‑a‑Service offerings that enable customers to access reliable, timely, and actionable competitive intelligence through APIs, data feeds, and analytics
Partner closely with Engineering, Data Science, UX, and customer‑facing teams to drive product discovery, prioritization, and execution

Skills

Product Management B2B SaaS Retail technology Competitive intelligence Data acquisition Web scraping

Custom Software Engineer

Custom Software Engineer

Responsibilities

Requirements

Skills

Agentic AI Engineer / Architect

Responsibilities

Requirements

Skills

AI / ML Engineer

Responsibilities

Requirements

Skills

Senior Data Engineer

Responsibilities

Requirements

Skills

Custom Software Engineering Lead

Responsibilities

Skills

Data Scientist - Senior

Compensation

Responsibilities

Requirements

Skills

Custom Software Engineering Lead

Responsibilities

Requirements

Skills

Senior Product Manager – Competitive Intelligence

Responsibilities

Skills

Benefits

Benefits