transformers
Fix InternVL attention when using qk_norm (38B and 78B)
#37620

Merged

Fix InternVL attention when using qk_norm (38B and 78B) #37620

yonigozlan merged 5 commits into huggingface:main from yonigozlan:fix-large-internvl

fix internvlvision attention when using qk_norm

d3b2bbc0

github-actions marked this pull request as draft 354 days ago

yonigozlan requested a review from

Cyrilvallez 354 days ago

yonigozlan marked this pull request as ready for review 354 days ago

Merge branch 'main' into fix-large-internvl

f1450b4c

Cyrilvallez approved these changes on 2025-04-19

Merge remote-tracking branch 'upstream/main' into fix-large-internvl

38111e04

nit

8d49d932

modular

dcf558c0

yonigozlan merged 6daa3eeb into main 353 days ago

Reviewers

Cyrilvallez

Assignees

No one assigned

Labels

None yet

Milestone

No milestone