text-generation-inference
adjust the `round_up_seq` logic to align with prefill warmup phase on…
#3224
Merged
Merged
adjust the `round_up_seq` logic to align with prefill warmup phase on… #3224
regisss
merged
1 commit into
huggingface:main
from
kaixuanliu:warmup-fix-exp
regisss
approved these changes
on 2025-05-12
kaixuanliu
changed the title
adjust the `round_up_seq` logit to align with prefill warmup phase on…
c264a42a
Login to write a write a comment.
Login via GitHub