transformers
f544b291 - Scope fix to encoder-decoder only; restore elif prefill_chunk_size for decoder-only

Commit
90 days ago
Scope fix to encoder-decoder only; restore elif prefill_chunk_size for decoder-only The previous commit incorrectly removed the `elif prefill_chunk_size` guard for decoder-only models. For decoder-only models without chunked prefill, lazy_initialization runs during the (non-compiled) prefill, so mark_static_address is correctly applied outside graph capture — early init is not needed there. Restore the original elif prefill_chunk_size block for decoder-only models, and scope the new encoder-decoder early init as a separate if branch. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Author
Parents
Loading