High-throughput model serving is rapidly shifting from brute force GPU scheduling to fine-grained kernel fusion and context disaggregation.
The vLLM v0.28.0 release demonstrates this shift with major architectural additions across the inference stack. It introduces Decode Context Parallel support and fused FlashKDA kernels for Kimi-K3, alongside optional shared-expert sharding that frees roughly seventeen gigabytes of memory per graphics card.
For DeepSeek V4 architectures, the engine now supports end-to-end sparse Multi-Head Latent Attention for standard decode, Multi-Token Prediction, and speculative decoding pipelines. Combined with Model Runner V2 maturation, which formalizes Execution, Prefill, and Decode disaggregation alongside weight offloading, these updates tackle memory bandwidth bottlenecks directly.
Speculative decoding also matures with local convolution candidates and confidence-scheduled verification to slash time to first token without degrading output quality.
The battleground for inference performance is no longer raw model size, but how cleanly your runtime manages memory bandwidth and kernel execution boundaries.

