transformers
[Whisper] Fix speculative decoding: UnboundLocalError, cache corruption, and speed regression
#48000
Merged
Overview
Commits
5
Changes
View On GitHub

[Whisper] Fix speculative decoding: UnboundLocalError, cache corruption, and speed regression #48000

ydshieh merged 5 commits into main from fix_whisper_integration_3
ydshieh
HuggingFaceDocBuilderDev
ydshieh [Whisper] Fix cache type and layer count for speculative decoding wit…
1ef6a616
ydshieh [Whisper] Restore absolute cache crop in _update_past_and_masks for s…
37649188
ydshieh ydshieh force pushed from 2b0999d8 to 37649188 3 days ago
ydshieh [Generate] Sync adaptive confidence threshold to generation_config fo…
f1ec6699
ydshieh ydshieh changed the title [Whisper] Fix UnboundLocalError: is_updated in WhisperAttention (test_speculative_decoding_distil) [Whisper] Fix speculative decoding: UnboundLocalError, cache corruption, and speed regression 3 days ago
ydshieh [Whisper] Format: wrap long EncoderDecoderCache line
dd33da4f
ydshieh [AudioFlamingo3] Fix is_updated UnboundLocalError in cross-attention …
cf7ebfb0
ydshieh
github-actions
github-actions
github-actions
ydshieh
github-actions
ydshieh ydshieh merged a5f41e09 into main 3 days ago
ydshieh ydshieh deleted the fix_whisper_integration_3 branch 3 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum