Kmoren/add penalties cu backend #25262
kmorennv
wants to merge
7 commits into
ggml-org:master
from
kmorennv:kmoren/add_penalties_cu_backend
sampling: enhance penalty handling in common_sampler_init
0ce6faf5
tests: add backend penalties sampling tests and utility functions
e82f0e7d
sampling: add support for top-k penalties in backend sampling
af9cf9c4
sampling: add fix to ensure stable numerical results. Preserve maske…
3ffeaeae
sampling: enhance penalty comparison tests with masking penalties logic
888f264d
add comments on padding
1834d9f6
sampling: add comments on modifications
38ad11c7
Login to write a write a comment.
Login via GitHub