Back to search

Agentic AI Architect

Lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms, bridging software intelligence and hardware acceleration.

  • San Jose, California, United States
  • Full-time
  • On-site
  • $149K–$238K per year
  • Posted Nov 16, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningDeveloper Tools & Infrastructure

Responsibilities

  • Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration
  • Architect RAG pipelines for enterprise-scale knowledge integration
  • Define end-to-end AI system architecture from data ingestion → reasoning → action
  • Develop advanced workflows using tool-using agents, planning & reasoning agents, and multi-agent collaboration frameworks
  • Evaluate and integrate leading LLMs (open-source and proprietary)
  • Optimize prompt engineering, memory, and reasoning capabilities
  • Co-design AI systems with FPGA acceleration, ASIC platforms, and heterogeneous compute (CPU/GPU/FPGA)
  • Explore LLM inference optimization on FPGA (quantization, compilation, partitioning)
  • Collaborate with hardware teams on EDA and system integration
  • Build internal platforms using LangChain, LlamaIndex, and custom agent orchestration framework
  • Develop reusable components for memory management, tool integration, and knowledge retrieval
  • Lead architecture reviews and guide engineering teams
  • Mentor senior engineers and influence cross-functional teams
  • Drive innovation in AI + hardware convergence

Requirements

  • Master’s or Bachelor’s degree
  • Experience in a AI/ML systems
  • Experience in a Hardware–software co-design

Nice to have: C++

Skills

AI/ML systemsDistributed systemsHardware–software co-designLarge Language Models (LLMs)RAG systemsAgentic AIFPGAASICEDA systemsHeterogeneous computing architecturesPythonLangChainLlamaIndexMLIRTVM

Benefits

  • incentive opportunities that reward employees based on individual and company performance

More jobs nearby

Full description

Job Details: Job Description: We are seeking an Agentic AI Architect to lead the design and development of next-generation agentic AI systems integrated with FPGA/ASIC platforms. This role sits at the intersection of: Large Language Models (LLMs) Agent frameworks & autonomous systems Retrieval-Augmented Generation (RAG) Hardware-aware AI system design (FPGA / ASIC / EDA) You will define architecture, drive technical strategy, and build scalable AI systems that bridge software intelligence and hardware acceleration. Key Responsibilities AI Architecture & System Design Design and implement agentic AI systems using LLMs, tools, and multi-agent orchestration Architect RAG pipelines for enterprise-scale knowledge integration Define end-to-end AI system architecture from data ingestion → reasoning → action Agentic AI & LLM Development Develop advanced workflows using: tool-using agents planning & reasoning agents multi-agent collaboration frameworks Evaluate and integrate leading LLMs (open-source and proprietary) Optimize prompt engineering, memory, and reasoning capabilities Hardware-Aware AI Optimization Co-design AI systems with: FPGA acceleration ASIC platforms heterogeneous compute (CPU/GPU/FPGA) Explore LLM inference optimization on FPGA (quantization, compilation, partitioning) Collaborate with hardware teams on EDA and system integration Framework & Platform Development Build internal platforms using LangChain LlamaIndex custom agent orchestration framework Develop reusable components for: memory management tool integration knowledge retrieval Technical Leadership Lead architecture reviews and guide engineering teams Mentor senior engineers and influence cross-functional teams Drive innovation in AI + hardware convergence What Makes This Role Unique Opportunity to define agentic AI architecture for hardware-driven systems Work at the convergence of: AI reasoning systems FPGA acceleration next-generation computing platforms High-impact role influencing future AI + semiconductor integration Impact You will help shape how AI agents interact with hardware, enabling: intelligent system orchestration real-time decision-making pipelines scalable AI deployment on FPGA platforms Summary This role is ideal for a senior technical leader who can: bridge LLM + Agentic AI + RAG with FPGA/ASIC system architecture and drive innovation in next-generation AI systems. The pay range below is for Bay Area California only. Actual salary may vary based on a number of factors including job location, job-related knowledge, skills, experiences, trainings, etc. We also offer incentive opportunities that reward employees based on individual and company performance. $149.1K - $238.2K USD We use artificial intelligence to screen, assess, or select applicants for the position. Applicants must be eligible for any required U.S. export authorizations. Qualifications: Master’s or Bachelor’s degree with 10+ years of experience in one or more of the following: AI/ML systems Distributed systems Hardware–software co-design Recognized expertise in AI/ Large Language Models (LLMs) Deep understanding of: LLM architectures and inference RAG systems and vector databases Agentic AI / autonomous agents Hands-on experience building: Production-grade LLM applications Multi-step reasoning and orchestration workflows Scalable and reliable AI systems in production Strong background in: FPGA / ASIC / EDA systems Heterogeneous computing architectures Familiarity with: Hardware acceleration for AI workloads Performance optimization across system stack Technical Skills Programming: Python C++ (preferred) Experience with: Distributed systems design APIs and microservices architecture Cloud and/or edge AI deployment Hands-on experience with: LLM fine-tuning, quantization, and model distillation On-device / edge AI deployment Robotics, autonomous systems, or real-time AI pipelines Knowledge of: Compiler stacks (e.g., MLIR, TVM) AI model optimization for FPGA platforms Job Type: Regular Shift: Shift 1 (United States of America) Primary Location: San Jose, California, United States Additional Locations: Posting Statement: All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.

Agentic AI Architect at Altera | Referso Jobs