transformers
simple align qwen2vl kv_seq_len calculation with qwen2
#33161

Merged

simple align qwen2vl kv_seq_len calculation with qwen2 #33161

zucchini-nlp merged 8 commits into huggingface:main from simonJJJ:qwen2vl_align_kv_seqlen_to_qwen2

qwen2vl_align_kv_seqlen_to_qwen2

bfe1a58a

zucchini-nlp commented on 2024-08-28

ArthurZucker commented on 2024-08-29

flash att test

c99c6bff

zucchini-nlp approved these changes on 2024-09-05

zucchini-nlp added run-slow

[run-slow] qwen2_vl

35f0e2d5

[run-slow] qwen2_vl fix OOM

ba455d35

[run-slow] qwen2_vl

ca2828cf

ArthurZucker approved these changes on 2024-09-05

zucchini-nlp commented on 2024-09-05

Update tests/models/qwen2_vl/test_modeling_qwen2_vl.py

00a14154

Update tests/models/qwen2_vl/test_modeling_qwen2_vl.py

2094e397

code quality

661b1483

zucchini-nlp merged 21fac7ab into main 1 year ago

Reviewers

zucchini-nlp

ArthurZucker

ShuaiBai623

Assignees

No one assigned

Labels

run-slow

Milestone

No milestone