[[
wikihub
]]
Search
⌘K
Explore
Activity
People
For Agents
Sign in
Explore
Activity
People
For Agents
Sign in
×
@jemoka / Jemoka Knowledge Base / raw/paper/moe_review/kbhmoereview_tan_scattered.md
Suggest edit
Cancel
Submit suggestion
Title
Name
Note
--- title: "MOEReview Tan: Scattered MoE" source: https://www.jemoka.com/posts/kbhmoereview_tan_scattered/ --- A single kernel to scatter the residuals and then run forward pass at the same time instead of copying and grouping first.