Applied AI Engineer
Teaching AI to say yes is easy. Teaching it when to say ‘no,’ ‘I don’t know,’ or ‘let me get a human’ is the actual job. Our client is hiring an Applied AI Engineer to build the second kind.
- Remote
- Remote
- Posted Nov 13, 2026
Responsibilities
- Turn scenario specs, decision models and assessment rubrics into prompts, application logic and testable behavior.
- Spot missing requirements and technical constraints, and raise them with Product, Engineering and SMEs.
- Define how AI models connect to application services and approved data sources: APIs, tool interactions, data structures, validation, error handling, permitted actions.
- Design prompts, structured outputs and validation logic, and catch invalid responses before they reach learners.
- Build conversational runtimes with controlled personas, session state and explicit state transitions.
- Keep simulation behavior, assessment logic and feedback separate, so feedback cannot change assessment results.
- Implement grounding and retrieval from approved knowledge sources, with source references where required.
- Keep code, prompts, schemas and evaluation assets under version control, and document them.
- Run bounded experiments with Product, with clear questions and success measures.
- Take validated prototypes into production with Engineering, and check behavior stays the same.
- Help build the technical controls that keep AI features compliant with accreditation requirements (issue flagging, review steps, disclosure, logging).
Requirements
- Experience in a learning products
- Experience in a assessment
- Experience in a simulations
- Experience in a regulated professional content
Nice to have: Background in learning products, assessment, simulations or regulated professional content
Skills
Expert prompt and context engineeringStructured outputs with JSON Schema, function calling and validation layersRAG designManaging token budgetsAgentic systemsDefining tool schemasAI evaluationLLM observability and tracingLLM securityPythonTypeScriptGitBitbucketCIJSON Schemafunction callingRAGhybrid searchrerankingcitation grounding
Full description
DistantJob
Company details are for members
Sign up for a free job alert to see DistantJob's profile, website and LinkedIn, and the same for every employer on Referso Jobs.