[`Mixtral` / `Awq`] Add mixtral fused modules for Awq #28240
add mixtral fused modules
da59bd6e
add changes from modeling utils
0067e2ef
add test
54815e9f
Merge remote-tracking branch 'upstream/main' into add-mixtral-fused-m…
bfa41aaf
fix test + rope theta issue
1ad8d77f
Update src/transformers/modeling_utils.py
2832c093
Merge branch 'main' into add-mixtral-fused-modules
8f47f637
Merge remote-tracking branch 'upstream/main' into add-mixtral-fused-m…
50d22d01
add tests
3e1bc0b2
younesbelkada
deleted the add-mixtral-fused-modules branch 2 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub