"Fast Inference from Transformers via Speculative Decoding."

Yaniv Leviathan, Matan Kalman, Yossi Matias (2022)

Details and statistics

DOI: 10.48550/ARXIV.2211.17192

access: open

type: Informal or Other Publication

metadata version: 2022-12-02

a service of  Schloss Dagstuhl - Leibniz Center for Informatics