GenAI evaluation methodologies jobs

Director I, Data Science- AI Products

Liberty Mutual Insurance · Posted Nov 10, 2024

Seattle, Washington, United States
Manager
3+ years

Apply with RefersoAI Apply on careers page

Lead a small team of data scientists while remaining hands‑on technically to build and scale AI‑enabled automation products for commercial underwriting and claims processing.

Responsibilities

Design, build, and evaluate GenAI solutions and agentic workflow automation systems
Build evaluation metrics and tools to assess GenAI systems’ performance, reliability, and safety
Identify core reusable capabilities within a particular use case and work with other teams to scale those capabilities across other franchises in the business
Collaborate with data scientists, AI & data engineers, and business partners to develop AI‑enhanced decision‑aid tools and drive strategic decision‑making
Communicate complex technical findings clearly to non‑technical stakeholders

Requirements

Ph.D. in Statistics, Mathematics, Economics, or another scientific field
Master’s degree (scientific field of study)

Skills

data science AI statistical knowledge for model diagnosis building agentic AI systems

GenAI evaluation methodologies jobs

Responsibilities

Requirements

Skills

Benefits

Responsibilities

Requirements

Skills