xla
[ragged-paged-attn] Use hidden states in kv cache and support any num…
#8891

Open

[ragged-paged-attn] Use hidden states in kv cache and support any num… #8891

zpcore wants to merge 1 commit into r2.7 from piz/cherry-pick-y

[ragged-paged-attn] Use hidden states in kv cache and support any num…

1dabbd66

zpcore marked this pull request as ready for review 1 year ago

zpcore requested a review from

yaochengji 1 year ago

Reviewers

yaochengji

Assignees

No one assigned

Labels

None yet

Milestone

No milestone