Qwen — Field Evidence

Beyond KV Reconstruction: Functional Reconstruction for MLA Draft Models in Speculative Decoding — Multi-head latent attention (MLA) is increasingly important for long-context LLM inference because compact latent states replace the growing key-value (KV) cache and reduce decoding