Inference & System Optimization Engineer

Responsibilities: - End-to-end engineering from model to inference system, hardware platform, and edge-side deployment - Continuous optimization of inference cost, latency, throughput, and stability - Key technologies: quantization, pruning, distillation, KV Cache, Continuous Batching, Paged Attention, Speculative Decoding, CUDA/Ascend/PPU operator optimization, multi-GPU distributed inference, model compilation, and cloud-edge collaboration Requirements : - Experience in large model inference efficiency optimization