feat: paged attention v2 #1183

OlivierDehaene merged 2 commits into main from feat/paged_attention_v2
OlivierDehaene
OlivierDehaene feat: paged attention v2
61ad9351
OlivierDehaene update flash attn
8d5e9773
dongs0104
OlivierDehaene
OlivierDehaene OlivierDehaene merged 12590fdc into main 2 years ago
OlivierDehaene OlivierDehaene deleted the feat/paged_attention_v2 branch 2 years ago
RonanKMcGovern
OlivierDehaene

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone