"ALISA: Accelerating Large Language Model Inference via Sparsity-Aware KV ..."

Youpeng Zhao, Di Wu, Jun Wang (2024)

Details and statistics

DOI: 10.48550/ARXIV.2403.17312

access: open

type: Informal or Other Publication

metadata version: 2024-04-10

a service of  Schloss Dagstuhl - Leibniz Center for Informatics