PreMoe: Lightening MoEs on Constrained Memory by Expert Pruning and Retrieval

Zehua Pei, Ying Zhang, Hui-Ling Zhen, Xianzhi Yu, Wulong Liu, Sinno Jialin Pan, Mingxuan Yuan, Bei Yu
January 2025
Cite
Type
Journal article
Publication
arXiv preprint arXiv:2505.17639

Add the full text or supplementary notes for the publication here using Markdown formatting.