Back to search

Program Manager/AI Solution Architect

Lead and architect AI initiatives for EdTech clients, driving end-to-end AI/ML system design, deployment, and governance.

  • Durham, North Carolina, United States
  • Posted Nov 4, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise Software

Responsibilities

  • Design end-to-end AI/ML system architecture
  • Architect Retrieval-Augmented Generation pipelines
  • Design multi-modal AI systems
  • Define model selection and routing strategies
  • Architect AI tutor agents
  • Design autonomous assessment agents
  • Build content generation pipelines
  • Define and govern the AI Harness
  • Define multi-agent orchestration patterns
  • Establish tool-use frameworks
  • Define and build Knowledge Graphs
  • Design learner memory systems
  • Implement LLM evaluation frameworks
  • Define distributed tracing
  • Partner with instructional designers
  • Lead proof-of-concept and pilot programs
  • Define and maintain AI architecture roadmap

Skills

AI Solution ArchitectAgentic AIAI/MLend-to-end AI/ML system architecturedata pipelinesmodel servinginference infrastructurefeedback loopsRetrieval-Augmented GenerationRAG pipelinesmulti-modal AI systemsClaude CodeCursorBlitzy PlatformsAdaptive Learning EnginesLLM orchestrationLanEligibleworkhainLangGraphAutoGenSemantic Kernelmodel selectionrouting strategiesOpenAIAnthropic ClaudeGoogle GeminiAWS BedrockAzure OpenAILlamaMistralAI tutor agentsmulti-turn dialogueSocratic questioninghint generationstep-by-step explanationautonomous assessment agentsauto-gradingrubric evaluationplagiarism detectionfeedback generationcontent generation pipelineslesson plansquiz bankssummariescurriculum mappinggenerative AIAI Harnessinput processingoutput safetyobservabilitytool-use frameworksMCP ProtocolOpenAI Function Callingdatabasessearch content librariesLMS workflowsKnowledge GraphsEdTech domain mappinglearning objectivesconceptsprerequisitescompetenciesstructured curriculum reasoninglearner memory systemslong-term progressmastery levelsknowledge gapsLLM evaluation frameworksRAGASDeepEvaldistributed tracingOpen TelemetryAWS AI servicesneo4jIRT based ML modelsPostgresEdtech systemsAWS AgentCoreAWS SagemakerClaude CodeCursorBlitzy PlatformsLanEligibleworkhainLangGraphAutoGenSemantic KernelOpenAIAnthropic ClaudeGoogle GeminiAWS BedrockAzure OpenAILlamaMistralOpenAI Function CallingOpen Telemetry

More jobs nearby

Full description

Job Description: Job title: Program Manager/ AI Solution Architect Role is remote or hybrid based out of Durham, NC A Strategic Leader who can drive and deliver multiple AI Initiatives for Clients at account level as Leader/SPOC and FDE with hands-on expertise on the below areas: Mandatory skills: - AI Solution Architect - Agentic AI - AI/ML - Design end-to-end AI/ML system architecture including data pipelines, model serving, inference infrastructure, and feedback loops - Architect Retrieval-Augmented Generation (RAG) pipelines for knowledge retrieval from curriculum content, textbooks, and learning repositories - Design multi-modal AI systems capable of processing text, audio, video, and assessments - Should have hands-on exp using Claude Code, Cursor, Blitzy Platforms - Establish architecture for Adaptive Learning Engines — systems that personalize content difficulty, pacing, and style based on learner behavior - Design LLM orchestration layers using frameworks such as LanEligible to workhain, LangGraph, AutoGen, or Semantic Kernel - Define model selection and routing strategies across providers (OpenAI, Anthropic Claude, Google Gemini, AWS Bedrock, Azure OpenAI, open-source Llama/Mistral) - Architect AI tutor agents capable of multi-turn dialogue, Socratic questioning, hint generation, and step-by-step explanation - Design autonomous assessment agents for auto-grading, rubric evaluation, plagiarism detection, and feedback generation - Build content generation pipelines for lesson plans, quiz banks, summaries, and curriculum mapping using generative AI - Define and govern the AI Harness — the full agentic AI stack from input processing to output safety and observability - Define multi-agent orchestration patterns for collaborative AI tasks across curriculum design, student support, and institutional reporting - Establish tool-use frameworks (MCP Protocol, OpenAI Function Calling) enabling agents to query databases, search content libraries, and trigger LMS workflows - Define/Build Knowledge Graphs for EdTech domain mapping learning objectives, concepts, prerequisites, and competencies for structured curriculum reasoning - Design learner memory systems tracking long-term progress, mastery levels, and knowledge gaps across sessions - Implement LLM evaluation frameworks using RAGAS, DeepEval to measure faithfulness, relevance, and educational accuracy - Define distributed tracing with Open Telemetry across the full AI request lifecycle for latency, cost, and quality monitoring - Partner with instructional designers and curriculum experts to ensure AI systems align with pedagogical best practices - Lead proof-of-concept and pilot programs for emerging AI capabilities (Adaptive learning system) - Define and maintain the AI architecture roadmap, ensuring alignment with business goals and EdTech product strategy - Should have experience working with neo4j, IRT based ML models, AWS AI services, Postgres, Edtech systems, AWS AgentCore, AWS Sagemaker and etc. Years of experience required: 15-20 Years of Experience: 25.00 Years of Experience

Program Manager/AI Solution Architect at Diverse Lynx | Referso Jobs