Public View
Suggest
Download this page (.md) Download entire wiki (.zip)
Clone entire wiki

MOEReview Fedus: Switch Transformers

At scale, with regularization (including dropout), k=1 on expert routing is fine!

Page updated