PR #41147 add rotary kernel support to Qwen3 model

add rotary kernel support to Qwen3 model #41147

MekkCyber merged 43 commits into huggingface:main from kaixuanliu:rotary-kernel

add rotary kernel support to Qwen3 model

69f2ca8c

delete unnecessary import

d2bf5c56

kaixuanliu marked this pull request as ready for review 301 days ago

github-actions requested a review from

ArthurZucker 301 days ago

github-actions requested a review from

Rocketknight1 301 days ago

adjust code

b0cbab56

kaixuanliu marked this pull request as draft 300 days ago

adjust code

8dede65d

Merge branch 'rotary-kernel' of https://github.com/kaixuanliu/transfo…

5c02189d

put get rotary kernel to hub_kernels.py

137069b0

fix wrong import

8ac3e1ea

kaixuanliu marked this pull request as ready for review 300 days ago

MekkCyber commented on 2025-09-25

refine code and adjust related modular code

29f83f23

Merge branch 'main' into rotary-kernel

7729b7f4

fix modular mismatch bug

94e4f608

Merge branch 'rotary-kernel' of https://github.com/kaixuanliu/transfo…

b96a7c90

ArthurZucker commented on 2025-10-08

Merge branch 'main' into rotary-kernel

aebac76f

update code, use lazy load kernels

af67a740

kaixuanliu marked this pull request as draft 275 days ago

fix check modular conversion issue

28c69d3f

Merge branch 'main' into rotary-kernel

cff15804

fix CI bug for qwen3-next

7ac16a17

fix CI issue

adce121a

delete unused code

b4757f45

kaixuanliu marked this pull request as ready for review 274 days ago

Merge branch 'main' into rotary-kernel

5ff6b16d

rename to `apply_rotary_transformers`

3bbfd646

MekkCyber commented on 2025-10-28

Merge branch 'main' into rotary-kernel

ec4ca1d5

kaixuanliu marked this pull request as draft 267 days ago

adjust import `lazy_load_kernel` location

caa549a6

kaixuanliu force pushed from 37faa920 to caa549a6 267 days ago

Update modular-generated modeling files with lazy_load_kernel import …

08a99598

fix conflicts

7915fc18

kaixuanliu marked this pull request as ready for review 267 days ago

kaixuanliu marked this pull request as draft 264 days ago

add more check

6f2d9588

Merge branch 'main' into rotary-kernel

e67ca600

kaixuanliu marked this pull request as ready for review 262 days ago

MekkCyber requested a review from

ArthurZucker 254 days ago

Merge branch 'main' into rotary-kernel

36c22052

MekkCyber approved these changes on 2025-11-14

ArthurZucker commented on 2025-11-14

use decorator to map kernels for functions

f4b12a72

small fix

6a3e6f34

small adjustment

702dc090

Merge branch 'main' into rotary-kernel

fdabd600

update code

fe2bf423

fix LINT issue

6f959695

Merge branch 'main' into rotary-kernel

2ebea7bb

update code to adapt to new `use_kernel_func_from_hub` API in kernels

e80cfd3d

do not consider check_modular first

c771acd3

update

d916ef06

fix

8670efec

add compatibility for old version `kernels`

fe20bd5b

ArthurZucker approved these changes on 2025-11-28

ArthurZucker commented on 2025-11-28

add rotary fn kernel to all models

898e36ed

kaixuanliu force pushed from 8b420e4c to 898e36ed 236 days ago

kaixuanliu marked this pull request as draft 236 days ago

update modular part

b8b68c7c

Revert "update modular part"

af25ce0e

update code

4b9da306

ArthurZucker marked this pull request as ready for review 236 days ago

MekkCyber approved these changes on 2025-11-28

MekkCyber merged 6587d77f into main 236 days ago

kaixuanliu deleted the rotary-kernel branch 45 days ago

Reviewers

ArthurZucker

MekkCyber

Rocketknight1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers add rotary kernel support to Qwen3 model #41147 Merged

add rotary kernel support to Qwen3 model #41147

transformers
add rotary kernel support to Qwen3 model
#41147

Merged