vllm
55712941 - [Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (#6852)

Commit

1 year ago

[Bug Fix] Illegal memory access, FP8 Llama 3.1 405b (#6852)

References

#6852 - [Bug Fix] Illegal memory access, FP8 Llama 3.1 405b

Author

LucasWilkinson

LucasWilkinson

Parents

Loading