Cache Allocation and Softmax Fixes #2433
jeffra
merged
7 commits into
master
from
cholmes/scratch-fix
Fix cache, softmax threads tweak
92be033a
fix reduce_width for softmax
de43550f
Merge branch 'master' into cholmes/scratch-fix
9f295bf0
Merge branch 'master' into cholmes/scratch-fix
edfb311c
use the user-defined max_tokens for memory-allocation
105e1f82
fix formatting
169762bb
Merge branch 'master' into cholmes/scratch-fix
3b9081e0
RezaYazdaniAminabadi
approved these changes
on 2022-11-02
jeffra
approved these changes
on 2022-11-02
disabled auto-merge 3 years ago
Manually disabled by user
Manually disabled by user
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub