Public View
Suggest
Download this page (.md) Download entire wiki (.zip)
Clone entire wiki

MOEReview Pan: Dense Training Sparse Inference

Train experts densely, and then during inference keep only topk

Page updated