vllm
[Bug Fix] Illegal memory access, FP8 Llama 3.1 405b
#6852

Merged

[Bug Fix] Illegal memory access, FP8 Llama 3.1 405b #6852

comaniac merged 1 commit into vllm-project:main from neuralmagic:fix-illegal-memory-access-fp8

add predicate to ensure we don't read of the end of the scales

b89e89ed

LucasWilkinson force pushed to b89e89ed 2 years ago

github-actions added ready

mgoin approved these changes on 2024-07-26

comaniac approved these changes on 2024-07-27

comaniac enabled auto-merge (squash) 2 years ago

comaniac merged 55712941 into main 2 years ago

Reviewers

comaniac

mgoin

Assignees

No one assigned

Labels

ready

Milestone

No milestone