Referso Jobs

Research Scientist (LLM Architectures)

CommonAI CIC · Posted Nov 9, 2026

Cambridge, England, United Kingdom
On-site
Full-time · Mid

Apply with RefersoAI Apply on careers page

Seeking a Research Scientist to drive research on new large language model architectures that reduce the cost of inference while retaining performance, treating serving hardware realities as first-class design constraints.

Responsibilities

Design and implement new model components, such as attention variants, structured or sparse layers, routing mechanisms, activations and training objectives.
Run controlled pretraining experiments at matched compute, from small scale up to larger models.
Analyse the structure that trained models learn, and what it means for efficiency and interpretability.
Explore adapting existing open models through continued training or distillation.
Work with engineers to turn research ideas into reliable, reproducible training runs and efficient kernels.

Requirements

PhD in machine learning, computer science, physics or a related field, or equivalent research experience
Nice to have: Triton
Nice to have: CUDA
Nice to have: sparsity
Nice to have: pruning

Skills

PyTorch JAX multi-GPU training LLM inference costs

Member of Technical Staff

Member of Technical Staff

Compensation

Responsibilities

Skills

Research Scientist (LLM Architectures)

Responsibilities

Requirements

Skills

Benefits

KV cache jobs

Compensation

Responsibilities

Skills

Responsibilities

Requirements

Skills

Benefits