auto-round
Support ByteDance-Seed/BAGEL-7B-MoT quantization in w4a16 format
#1633
Merged
Merged
Support ByteDance-Seed/BAGEL-7B-MoT quantization in w4a16 format #1633
lvliang-intel
merged
37 commits into
main
from
lvl/support_bagel_mot
Support BAGEL quantization
dd92ae04
update code
14ed1bd3
![pre-commit-ci[bot]](https://avatars.githubusercontent.com/in/68672?v=4&s=60)
[pre-commit.ci] auto fixes from pre-commit.com hooks
2435fa04
Update auto_round/utils/bagel_loader.py
7795f1d1
Update auto_round/utils/model.py
c1bfc7d0
Fix save_pretrained to use state_dict() instead of named_parameters()
9ac70a94
remove IPEX related code, doc, and test (#1787)
82c5311a
Support BAGEL quantization
58d80316
[pre-commit.ci] auto fixes from pre-commit.com hooks
2b5df312
fix typo
f15d897d
[pre-commit.ci] auto fixes from pre-commit.com hooks
576e4740
let pre-commit not change MOT to NOT
595f22da
Restore auto_round_kernel/version.py deleted during rebase
3bd5343b
[pre-commit.ci] auto fixes from pre-commit.com hooks
a056682e
Update auto_round/utils/bagel_loader.py
a73fa5c1
Fix FP8 CT export metadata for KV cache and attention (#1752)
8bac01dd
Enhance ark test workflow (#1805)
4f1a044b
Fix GGUF-K RTN routing and fake eval dtype normalization (#1807)
641827aa
Fix mixed-precision accuracy regression when AutoScheme runs with CPU…
b99b1ecb
Add Dockerfile with torch installed, enhance image build logic to che…
33a130a0
set default DYNAMO_CACHE_SIZE_LIMIT to 16 (#1786)
85b46e42
reduce XPU memory usage in CI (#1812)
1e346fe6
[refactor] decouple calibaration code (#1765)
bb068956
[ARK CI] Enhance auto-round-lib CI test (#1801)
77dc57ac
Support BAGEL quantization
49dc905a
Support BAGEL quantization
7b92f143
add ut
fb89eb82
Merge branch 'main' into lvl/support_bagel_mot
574450ee
[pre-commit.ci] auto fixes from pre-commit.com hooks
1567f9ad
Support BAGEL quantization
ec7936e3
Support BAGEL quantization
0d40acdb
[refactor] decouple calibaration code (#1765)
65eb04c5
fix ut
4538be3f
[pre-commit.ci] auto fixes from pre-commit.com hooks
9e5893ef
fix pre-commit
2b5ee144
Merge branch 'main' into lvl/support_bagel_mot
06157c14
Merge branch 'main' into lvl/support_bagel_mot
e631d4df
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub