CMoE: Fast Carving of Mixture-of-Experts for Efficient LLM Inference

Zehua Pei, Lancheng Zou, Hui-Ling Zhen, Xianzhi Yu, Wulong Liu, Sinno Jialin Pan, Mingxuan Yuan, Bei Yu
January 2025
Cite
Type
Journal article
Publication
arXiv preprint arXiv:2502.04416

Add the full text or supplementary notes for the publication here using Markdown formatting.