Skip to content

Comments

[DICP] Add paged attention.#864

Open
Reinerzhou wants to merge 2 commits intomainfrom
zhousl/add_paged_attention
Open

[DICP] Add paged attention.#864
Reinerzhou wants to merge 2 commits intomainfrom
zhousl/add_paged_attention

Conversation

@Reinerzhou
Copy link
Member

  1. Add paged attention impl;
  2. Add paged attention test.

@Reinerzhou Reinerzhou requested a review from jinminxi104 as a code owner July 2, 2024 03:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant