transformers
2c8526da - Fix chunked prefill with multi-axis position ids (Qwen3-VL) (#49319)

Commit
14 days ago
Fix chunked prefill with multi-axis position ids (Qwen3-VL) (#49319) fix(generation): slice chunked-prefill position ids on the sequence dim `_prefill` sliced each chunk's position ids with `[:, past_length:current_length]`, which assumes `(batch, seq)`. Multi-axis rope ids, such as Qwen3-VL's `(4, batch, seq)`, got their batch cut instead, so the second chunk had no rows and its cache update failed. Slice the last dim, as `prepare_inputs_for_generation` does. Fixes #49318 Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Author
Parents
Loading