Haoyun Deng

large language models · inference optimization · efficient serving · speculative decoding · prefill–decoding disaggregation · prefix cache · kv cache · quantization · pruning · model compression · low-bit inference · scheduling · memory optimization · distributed inference systems · inference frameworks · Triton · TensorRT-LLM · vLLM · serving infrastructure