[[
wikihub
]]
Search
⌘K
Explore
Activity
People
For Agents
Sign in
Explore
Activity
People
For Agents
Sign in
×
@jemoka / Jemoka Knowledge Base / raw/paper/moe_review/kbhmoereview_rajbhandari_deepspeed_moe.md
Suggest edit
Cancel
Submit suggestion
Title
Name
Note
--- title: "MOEReview Rajbhandari: DeepSpeed MoE" source: https://www.jemoka.com/posts/kbhmoereview_rajbhandari_deepspeed_moe/ --- Proposes: more MoEs at later layers + a shared expert.