Advisory Engineer, On-Device AI Systems & Inference Optimization
Responsible for the full-link deployment of on-device models, including model conversion, quantization, compilation, runtime integration, operator adaptation, memory management, version compatibility, and phased release. Focus on performance profiling, bottleneck identification, and inference optimization for CPU/GPU/NPU heterogeneous computing environments (Windows/Linux/Android).
- Beijing, China
- Posted Nov 16, 2026
INDUSTRYSoftware & InternetSaaS & Enterprise SoftwareAI & Machine LearningData & Analytics
Responsibilities
- Responsible for full-link on-device model deployment: model conversion, quantization, compilation, runtime integration, operator adaptation, memory management, version compatibility, and phased release.
- Perform performance profiling, bottleneck identification, and inference optimization for CPU/GPU/NPU heterogeneous computing and Windows/Linux/Android environments.
- Implement token routing, device-cloud task orchestration, low-latency multimodal inference, and privacy-preserving personalization capabilities.
- Implement algorithm optimizations such as FP4/INT4 QAT, speculative decoding, and on-policy distillation to balance accuracy, latency, throughput, memory, and stability.
- Align with Agentic OS framework metrics, building performance regression, stability monitoring, and engineering best practices.
- Resolve engineering issues related to on-device resource constraints, power/heat, compatibility, and abnormal degradation, driving issue closure.
Requirements
- Master's degree or above in Artificial Intelligence, Computer Science, or Electronic Information Technology
- Experience in a AI Systems
Nice to have: Quantization, Graph optimization, Operator optimization, Memory optimization, Heterogeneous scheduling, Performance profiling
Skills
Full description
LenovoCompany details are for members
Sign up for a free job alert to see Lenovo's profile, website and LinkedIn, and the same for every employer on Referso Jobs.