Fix more int overflow during quant (PPL/CUDA). #6563
Fix more int overflow during quant.
c481e11f
slaren
approved these changes
on 2024-04-28
Fix some more int overflow in softmax.
91c10ef2
dranger003
force pushed
from
4947778d
to
91c10ef2
1 year ago
Revert back to int64_t.
0258f9bd
dranger003
deleted the ppl-int-overflow-fix branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub