vllm
d366ccc4 - [RFC] [Mistral] FP8 format (#10130)

Commit

308 days ago

[RFC] [Mistral] FP8 format (#10130) Signed-off-by: mgoin <mgoin64@gmail.com> Co-authored-by: mgoin <mgoin64@gmail.com>

References

Author

patrickvonplaten

Parents