"Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints."

Aran Komatsuzaki et al. (2023)

Details and statistics

DOI:

access: open

type: Conference or Workshop Paper

metadata version: 2024-07-24

a service of  Schloss Dagstuhl - Leibniz Center for Informatics