text-generation-inference
Add support for FP8 on compute capability >=8.0, <8.9
#2213
Merged

Add support for FP8 on compute capability >=8.0, <8.9 #2213

danieldk merged 1 commit into main from feature/fp8-marlin
danieldk
flozi00 Add support for FP8 on compute capability >=8.0, <8.9
dd0ed67b
danieldk danieldk force pushed from 74fdd83f to dd0ed67b 1 year ago
OlivierDehaene
OlivierDehaene approved these changes on 2024-07-11
danieldk danieldk merged cb150eb2 into main 1 year ago
danieldk danieldk deleted the feature/fp8-marlin branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone