Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 0 additions & 6 deletions docs/api/attention.md
Original file line number Diff line number Diff line change
Expand Up @@ -33,12 +33,6 @@ what runs when you call `op(...)`.
heading_level: 3
members: ["__init__", "forward"]

::: tileops.attention.GroupedQueryAttentionPrefillFwdOp
options:
show_root_heading: true
heading_level: 3
members: ["__init__", "forward"]

::: tileops.attention.GroupedQueryAttentionPrefillVarlenFwdOp
options:
show_root_heading: true
Expand Down
14 changes: 10 additions & 4 deletions docs/api/moe.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,10 +6,10 @@ Both are documented under each op — `__init__` and `forward`, where `forward`
what runs when you call `op(...)`.

A routed mixture-of-experts layer is available two ways here. `FusedMoeFwdOp` runs
the whole FFN. The rest are its stages, callable on their own: the ops that move
tokens into an expert-contiguous layout and back, and the expert GEMMs that run on
it. The GEMMs come in a padded form and a tight one, and the routing has to produce
the layout the GEMM expects.
the whole FFN. The rest are its stages, callable on their own: the op that picks
each token's experts, the ops that move tokens into an expert-contiguous layout and
back, and the expert GEMMs that run on it. The GEMMs come in a padded form and a
tight one, and the routing has to produce the layout the GEMM expects.

## Fused forward

Expand All @@ -21,6 +21,12 @@ the layout the GEMM expects.

## Routing and layout

::: tileops.moe.FusedTopKOp
options:
show_root_heading: true
heading_level: 3
members: ["__init__", "forward"]

::: tileops.moe.MoePrePermuteFwdOp
options:
show_root_heading: true
Expand Down
Loading