vllm
[Bugfix] Apply same sampling parameters for both `n=1` and `n>1`
#26005

Merged

Commits

use sampling parameters from generation_config.json in both n=1 and n>1 cases

kmaehashi committed 304 days ago

Loading