Jobs Referso Partner API

Free job alerts

LLM observability tools jobs

Job titleLocation

Popular:United States Canada Viet Nam

All filtersRefine by skill, company, date, job type, industry and more

Company

Skillsjobs that use all of them

LLM observability tools

Popular

Date posted

Any timePast hourPast 24 hoursPast week

Workplace

RemoteHybridOn-site

Job type

Full-timePart-timeContractInternshipTemporary

Experienceyears required

0–2 years2–5 years5–10 years10+ years

Salary

Salary listed

Education

High schoolAssociate degreeBachelor's degreeProfessional certificatePostgraduate degree

Industryfield of work

Software & InternetHardware & ElectronicsEngineeringHealthcareLife Sciences & ResearchFinance & AccountingSales & Business DevelopmentMarketing & CommunicationsCreative & DesignCustomer Service & SupportAdministrative & OfficeHuman Resources & RecruitingLegal & ComplianceManagement & OperationsEducation & TrainingRetailHospitality & Food ServiceManufacturing & ProductionSkilled Trades & ConstructionTransportation & LogisticsFacilities, Cleaning & SecuritySocial Services & Public SectorEnergy, Environment & Agriculture

1 selected

Skill:LLM observability tools

Referso Jobs

Fresh jobs from employer career sites in the US and Europe. Search free, get alerts free, and let Referso apply when you're ready.

Job seekersSearch jobs Free job alerts Remote jobs

RefersoAuto-apply How it works Pricing Log in

For companiesPartner API (beta)API docs Contact sales

CompanyAbout Contact Privacy Terms

© 2026 Referso. Jobs link to the original posting; Referso is not affiliated with the employers listed.Privacy Terms Request a removal

1–2 jobs· newest first

Agentic AI Builder
Sia · Mumbai, India
On-site · Full-time · Mid
Senior AI Engineer, Release Engineering
Intercontinental Exchange Holdings, Inc. · Atlanta, US
On-site · Senior

+10K new in the last hour

Agentic AI Builder

Sia · Posted Nov 6, 2026

Mumbai, Maharashtra, India
On-site
Full-time · Mid
2–6 years

Apply with Referso

AI

Apply on careers page

Design, build, and industrialise AI agents and multi‑agent workflows for enterprise clients, ensuring production readiness and operational handover.

Responsibilities

Work with consultants and business teams to identify agent use cases and translate business processes into clear agent requirements and acceptance criteria.
Design agent architectures for business workflows, deciding when a single agent, a multi‑agent pattern or a deterministic workflow with LLM steps is the right choice.
Implement orchestration, tool calling and control flow in Python using frameworks such as LangGraph, LangChain, the Claude Agent SDK or OpenAI SDK, or custom code where that is the better choice.
Build tools and connectors to enterprise APIs and data sources, including MCP servers, with clear schemas, error handling and permissioning.
Engineer context deliberately: retrieval over enterprise data, prompt and context design, and state and memory management across steps and sessions.

Requirements

Bachelor's or Master's degree in Computer Science, Engineering or a related field, or equivalent practical experience.
Nice to have: Model Context Protocol (MCP)
Nice to have: multi‑agent patterns (planner, executor, supervisor, handoff)
Nice to have: automation platforms (n8n, Microsoft Copilot Studio)
Nice to have: model routing

Skills

Python software engineering fundamentals testing packaging typing asynchronous programming agent framework or SDK (LangGraph, LangChain, Claude Agent SDK, OpenAI SDK or equivalent)agent state memory control flow retrieval over enterprise data vector search prompt engineering LLM observability tracing

See full job description

Senior AI Engineer, Release Engineering

Intercontinental Exchange Holdings, Inc. · Posted Nov 5, 2026

Atlanta, Georgia, United States
On-site
Senior
5+ years

Apply with RefersoAI Apply on careers page

Senior AI Engineer focused on building and operating an internal AI-powered developer platform within the Release Engineering Development team.

Responsibilities

Design, build, and maintain the agent platform including API, MCP integrations, and intent-routing logic
Build MCP integrations for CI/CD, source control, ticketing, and deployment tools
Maintain skill and agent registry matching user intent
Design multi-step, tool-using agents for release-readiness and rollback assistance
Author, test, and iterate on prompts and context structures

Requirements

Bachelor’s degree or equivalent
Nice to have: LangChain
Nice to have: LlamaIndex
Nice to have: LiteLLM
Nice to have: AutoGen

Skills

CI/CD Git GitHub Bitbucket Node.js TypeScript Go

cost and latency tracking

enterprise API integration

cloud deployment fundamentals

Claude Agent SDK

LLM observability tools

relational database design

retrieval-augmented generation

vector databases

LLM observability tools

evaluation sets

regression testing

quality metrics

distributed systems

See full job description