vllm
cd7edc4e - [Bugfix] Fix empty (nullptr) channelwise scales when loading wNa16 using compressed tensors (#6798)

Commit
1 year ago
[Bugfix] Fix empty (nullptr) channelwise scales when loading wNa16 using compressed tensors (#6798)
Parents
Loading