PR #2856 Add fp8 kv cache for ROCm

Add fp8 kv cache for ROCm #2856

mht-sharma merged 5 commits into main from fp8_kvcache_rocm

add fp8 kv cache for rocm

fa14d71a

mht-sharma changed the title ~~Add fp8 kv cache for rocm~~ Add fp8 kv cache for ROCm 1 year ago

improvements

43370a1f

mht-sharma marked this pull request as ready for review 1 year ago

mht-sharma requested a review from

danieldk 1 year ago

update log statement

a7cf5e85

danieldk commented on 2025-01-10

Merge branch 'main' into fp8_kvcache_rocm

8ffb5b36

remove bookkeeping field

5b10e5bc

mht-sharma requested a review from

danieldk 1 year ago

Narsil approved these changes on 2025-01-17

mht-sharma merged c20025db into main 1 year ago

mht-sharma deleted the fp8_kvcache_rocm branch 1 year ago

Reviewers

Narsil

danieldk

Assignees

No one assigned

Labels

None yet

Milestone

No milestone