Back to search

Advisory Engineer, On-Device AI Systems & Inference Optimization

Responsible for the full-link deployment of on-device models, including model conversion, quantization, compilation, runtime integration, operator adaptation, memory management, version compatibility, and phased release. Focus on performance profiling, bottleneck identification, and inference optimization for CPU/GPU/NPU heterogeneous computing environments (Windows/Linux/Android).

  • Beijing, China
  • Posted Nov 16, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningData & Analytics

Responsibilities

  • Responsible for full-link on-device model deployment: model conversion, quantization, compilation, runtime integration, operator adaptation, memory management, version compatibility, and phased release.
  • Perform performance profiling, bottleneck identification, and inference optimization for CPU/GPU/NPU heterogeneous computing and Windows/Linux/Android environments.
  • Implement token routing, device-cloud task orchestration, low-latency multimodal inference, and privacy-preserving personalization capabilities.
  • Implement algorithm optimizations such as FP4/INT4 QAT, speculative decoding, and on-policy distillation to balance accuracy, latency, throughput, memory, and stability.
  • Align with Agentic OS framework metrics, building performance regression, stability monitoring, and engineering best practices.
  • Resolve engineering issues related to on-device resource constraints, power/heat, compatibility, and abnormal degradation, driving issue closure.

Requirements

  • Master's degree or above in Artificial Intelligence, Computer Science, or Electronic Information Technology
  • Experience in a AI Systems

Nice to have: Quantization, Graph optimization, Operator optimization, Memory optimization, Heterogeneous scheduling, Performance profiling

Skills

C++PythonOn-device AI inference deploymentSystem optimizationONNX Runtimellama.cpTensorRTOpenVINOTVM

Full description

Additional Locations: * China - Beijing - 北京(Beijing) We are Lenovo. We do what we say. We own what we do. We WOW our customers. Lenovo is a US$83 billion revenue global technology powerhouse, ranked #153 in the Fortune Global 500, and serving millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, Lenovo has built on its success as the world’s largest PC company with a full-stack portfolio of AI-enabled, AI-ready, and AI-optimized devices (PCs, workstations, smartphones, tablets), infrastructure (server, storage, edge, high performance computing and software defined infrastructure), software, solutions, and services. Lenovo’s continued investment in world-changing innovation is building a more equitable, trustworthy, and smarter future for everyone, everywhere. Lenovo is listed on the Hong Kong stock exchange under Lenovo Group Limited (HKSE: 992) (ADR: LNVGY). This transformation together with Lenovo’s world-changing innovation is building a more inclusive, trustworthy, and smarter future for everyone, everywhere. To find out more visit www.lenovo.com, and read about the latest news via our StoryHub. 核心职责 负责端侧模型部署全链路:模型转换、量化、编译、运行时接入、算子适配、内存管理、版本兼容与灰度发布。 面向 CPU/GPU/NPU 异构计算和 Windows/Linux/Android 等端侧环境,进行性能剖析、瓶颈定位和推理优化。 落地 token routing、device-cloud task orchestration、多模态低时延推理、隐私保护个性化等系统能力。 落地 FP4/INT4 QAT、speculative decoding、on-policy distillation 等算法优化,保证精度、时延、吞吐、内存和稳定性平衡。 对齐 Agentic OS 框架指标,建设性能回归、稳定性监控和工程最佳实践。 解决端侧资源受限、功耗/热、兼容性、异常降级等工程问题,推动问题闭环。 任职要求 硕士及以上学历,人工智能、计算机科学、电子信息技术等相关专业; 具备扎实的软硬件联合优化能力,理解 CPU/GPU/NPU 微架构、指令集、算子库、内存层次与异构调度机制,能够通过编译优化、算子优化、运行时优化和调度策略的协同设计最大化硬件算力; 具备端侧 AI 推理部署和系统优化经验,熟悉 C++/Python,具备较强工程落地能力。 熟悉至少一种推理/编译/运行时链路,如 ONNX Runtime、llama.cp、TensorRT、OpenVINO、TVM、或自研推理运行时等。 熟悉量化、图优化、算子优化、内存优化、异构调度、性能剖析工具中的多个方向。 理解端侧 OS 与硬件约束,能在 Windows/Linux/Android 等环境完成部署与调优。 具备跨团队协作和工程问题攻坚能力。 Additional Locations: * China - Beijing - 北京(Beijing)

Advisory Engineer, On-Device AI Systems & Inference Optimization at Lenovo | Referso Jobs