transformers
Remove size check between attn_weights and kv_seq_len for phi3
#32339

Merged

Remove size check between attn_weights and kv_seq_len for phi3 #32339

ArthurZucker merged 2 commits into huggingface:main from helunwencser:static_cache_for_phi_3

Remove size check between attn_weights and kv_seq_len

7f48c110

ArthurZucker approved these changes on 2024-07-30

add unit tests

6d655fe2

helunwencser force pushed to 6d655fe2 2 years ago

zucchini-nlp approved these changes on 2024-07-31

ArthurZucker merged 48ed24c5 into main 2 years ago

helunwencser deleted the static_cache_for_phi_3 branch 2 years ago

Reviewers

zucchini-nlp

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone