- Beijing, China
- Full-time · Senior
Responsible for the framework architecture design of On-Device Agentic OS, including task orchestration, tool calling, context/memory management, token routing, device-cloud task orchestration, resource scheduling, and inference runtime coordination.
Responsibilities
- Design On-Device Agentic OS framework architecture (task orchestration, tool calling, context/memory management, token routing, device-cloud task orchestration, resource scheduling, and inference runtime coordination)
- Establish and own end-to-end metrics and benchmarks (P50/P95/P99 inference latency, tokens/s throughput, CPU/GPU/NPU resource utilization, memory usage, power/thermal constraints, model accuracy, Agent recall rate, overall task completion quality)
- Drive cross-layer optimization loop (FP4/INT4 QAT, speculative decoding, on-policy distillation, runtime optimization, and heterogeneous scheduling) to jointly improve on-device performance and quality
- Define framework constraints, degradation strategies, device-cloud collaboration strategies, and privacy protection mechanisms for CPU/GPU/NPU heterogeneous computing and on-device environments (Windows/Linux/Android)
- Translate algorithmic innovation and inference optimization into deployable, measurable, and reusable system capabilities
Requirements
- Master's degree or above in Artificial Intelligence, Computer Science, or Electronic Information Technology
- Nice to have: On-device Agent productization experience
