DeepSeek — Field Evidence

COBS: Cumulant Order Block Sparse Attention — Block sparse attention is a hardware friendly way to alleviate the key-value (KV) cache read bottleneck in large language models (LLMs). However, it is not prevalent among leading open-weight LLMs, which rely instead on dense attentio