Model evaluation frameworks jobs

Cyber Security Engineer - Sr. Consultant level (AI Engineer)

Visa · Posted Sep 18, 2026

Open

Singapore
On-site
Full-time · Senior
8+ years

Cyber Security Engineer - Sr. Consultant level (AI Engineer)

Visa · Posted Sep 18, 2026

Open

Singapore
On-site
Full-time · Senior
8+ years

Developer - AI Engineer

Progression Inc · Posted Nov 4, 2026

Open

Remote, United States
Remote
Senior
7+ years

Apply with RefersoAI Apply on careers page

AI Engineer responsible for developing and optimizing prompt engineering strategies, designing RAG frameworks, and deploying AI applications using Python, Azure OpenAI, and AWS cloud services.

Responsibilities

Lead the development and optimization of prompt engineering strategies
Design and implement Retrieval-Augmented Generation (RAG) frameworks
Develop and deploy AI applications using Python, Azure OpenAI, and AWS cloud services
Architect and operationalize responsible AI systems, including generative AI applications and RLHF instruction models
Build, fine-tune, and evaluate machine learning models using Python, Java, and open-source frameworks

Requirements

Bachelor's Degree in Computer Science, Engineering, or related field

Skills

Python Azure OpenAI AWS cloud services Retrieval-Augmented Generation (RAG)Large Language Models (LLMs)prompt engineering

Founding Data Scientist

Weekday AI · Posted Nov 3, 2026

Open

Gurugram, Haryana, India
On-site
Full-time
8+ years

Apply with RefersoAI Apply on careers page

Founding Data Scientist responsible for building, fine‑tuning, and deploying large language models for an AI‑powered personal assistant.

Responsibilities

Fine‑tune open‑weight language models using SFT, DPO, and reinforcement learning
Design reward functions and optimise model policies
Build high‑quality training datasets from agent trajectories and preference signals
Develop benchmarks and evaluation frameworks for reasoning, tool usage, and task completion
Execute distributed model training and high‑throughput inference with PyTorch, FSDP, DeepSpeed, vLLM, and SGLang

Requirements

Nice to have: PPO
Nice to have: GRPO
Nice to have: RLHF
Nice to have: reward modelling
Nice to have: advanced reinforcement learning techniques

Skills

SFT LLM Python PyTorch Transformers attention mechanisms LoRA/PEFT