transformers
fix: restore `_attn_implementation `and fix request offset in `generate_batch()`
#45943
Merged
Merged
fix: restore `_attn_implementation `and fix request offset in `generate_batch()` #45943
ArthurZucker
merged
6 commits into
huggingface:main
from
sergiopaniego:fix/continuous-batching-training-mode
fix: restore _attn_implementation and fix request offset in generate_…
739db072
Merge branch 'main' into fix/continuous-batching-training-mode
e0f843d3
Lower the attn switch to the innermost scope and robust request reord…
05d118da
Merge branch 'main' into fix/continuous-batching-training-mode
aee437ef
inference mode to no grad
7f260045
Merge branch 'fix/continuous-batching-training-mode' of github.com:se…
12a4a92f
ArthurZucker
approved these changes
on 2026-05-14
Login to write a write a comment.
Login via GitHub