transformers
[Continous Batching] fix do_Sample=True in continuous batching
#40692

Merged

[Continous Batching] fix do_Sample=True in continuous batching #40692

ArthurZucker merged 6 commits into main from cp-do-sample

fix do_Sample=True in continous batching

df4965c2

kashif requested a review from

McPatate 142 days ago

McPatate approved these changes on 2025-09-04

Merge branch 'main' into cp-do-sample

0051f70f

added test

40a32ece

fix top_p

0b6518ff

test

c86227a5

kashif commented on 2025-09-05

Update examples/pytorch/continuous_batching.py

94eb97a3

ArthurZucker approved these changes on 2025-09-08

ArthurZucker merged 3f7bda42 into main 138 days ago

ArthurZucker deleted the cp-do-sample branch 138 days ago

Reviewers

ArthurZucker

McPatate

Assignees

No one assigned

Labels

None yet

Milestone

No milestone