PR #2028 Add FP8 KVCache support - SemanticDiff

Commits

add kvcache fp8 support

mohit@huggingface.co committed 1 year ago
Merge branch 'main' into fp8_kvcache

mht-sharma committed 1 year ago
rebase and update

mht-sharma committed 1 year ago
fix

mht-sharma committed 1 year ago
fixrs

mht-sharma committed 1 year ago
add docs

mht-sharma committed 1 year ago
fix style

mht-sharma committed 1 year ago
update port

mht-sharma committed 1 year ago
rename doc

mht-sharma committed 1 year ago
update doc

mht-sharma committed 1 year ago
update launcher

mht-sharma committed 1 year ago
update heading

mht-sharma committed 1 year ago
revert makefile

mht-sharma committed 1 year ago
remove example

mht-sharma committed 1 year ago
add torch dtype

mht-sharma committed 1 year ago
add AMMO example

mht-sharma committed 1 year ago
updated doc

mht-sharma committed 1 year ago
update launcher

mht-sharma committed 1 year ago
updated doc

mht-sharma committed 1 year ago
updated docs

mht-sharma committed 1 year ago
fix formatting

mht-sharma committed 1 year ago
updated doc

mht-sharma committed 1 year ago

Loading