Llama — Field Evidence

At-the-Roofline Sparse Tensor Contractions on Vector Processors for Transformer Inference — Fine-grained weight pruning and activation sparsification have emerged as effective approaches for reducing the compute and memory cost of inference for Transformer models. In the moderate