auto-round
[research feature] Introduce INT4 support at the algorithm level
#1641
Merged
Overview
Commits
97
Changes
View On GitHub

[research feature] Introduce INT4 support at the algorithm level #1641

wenhuach21 merged 97 commits into main from hadamard_change
wenhuach21
wenhuach21 tmp change
ff91f071
wenhuach21 wenhuach21 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 67 days ago
wenhuach21 wenhuach21 marked this pull request as draft 67 days ago
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
65f7a6f3
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-03-31
wenhuach21 o_proj quantization has not been handled
267b6a26
wenhuach21 update
9609db37
wenhuach21 update
c13d24ba
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
eb3ee0a4
wenhuach21 update
f41771c1
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
14557026
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
df143716
wenhuach21 support not using fast hadamard
e3c1d93e
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
02ce508f
wenhuach21 update
a978b4c6
wenhuach21 update
d790ce03
wenhuach21 support opt-125m by AI, it seems that the accuracy dropped after rota…
936c2f52
wenhuach21 update
8ca79734
wenhuach21 update
c07b3b1f
wenhuach21 wenhuach21 changed the title [not4landing]hadamard change inplace hadamard 58 days ago
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
89516fe9
wenhuach21 update
3760a3b7
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
8ac1ceee
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
ccf86610
wenhuach21 fix
7a7276e0
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
cb09ae51
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
a009d9a8
wenhuach21 Merge branch 'main' into hadamard_change
8c1b4f60
wenhuach21 fix
54b2d612
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
9d344fc4
wenhuach21 tmp change
319ff2da
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
ef99f905
wenhuach21 support group_size
bf79387c
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
f1173e86
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
ea4804d5
wenhuach21 upate
9ad51135
wenhuach21 remove 0.9 scale in act quantization
0678b0d2
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
d9614255
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
1d941021
wenhuach21 fix
c78214d7
wenhuach21 fix
c52dc83e
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
f49e7baf
wenhuach21 update
d55d0107
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
c937152d
wenhuach21
wenhuach21 commented on 2026-04-14
wenhuach21 Apply suggestions from code review
39a61893
azure-pipelines
wenhuach21 update
d98bf85c
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
7f9aab8d
azure-pipelines
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
21ce3a77
azure-pipelines
wenhuach21 split rtn and optrtn
73598522
azure-pipelines
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
f8f1a349
azure-pipelines
wenhuach21 tmp change
393950b3
wenhuach21 try to support act clip
f1c42cca
wenhuach21 update
b860b406
wenhuach21 update
2e1a3901
wenhuach21 support unfused
8095ab12
wenhuach21 much better result for INT4
abaea6e2
wenhuach21 fix rtn bug
0374bd20
wenhuach21 start to refine
56505e8c
wenhuach21 sync with main on hadamard's change
74c115d4
wenhuach21 Merge branch 'main' into hadamard_change
d7b2a5e8
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
692e5305
wenhuach21 rename and unify API
03c861b2
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
5745000a
wenhuach21 Merge branch 'main' into hadamard_change
31708fe2
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
381fe7ab
wenhuach21 fix
f52fb6be
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
bb9118ee
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
5f8c22ac
wenhuach21 update
8a33c9ef
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
099bccdf
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
f5b7e591
wenhuach21 wenhuach21 changed the title inplace hadamard [research feature] inplace hadamard to support INT4 45 days ago
wenhuach21 wenhuach21 marked this pull request as ready for review 45 days ago
wenhuach21 fix
b3c8c636
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
d1ab38ea
wenhuach21 wenhuach21 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 45 days ago
wenhuach21 fix preci
6c1b1e94
wenhuach21 fix
d9732f5b
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-04-21
wenhuach21 Update auto_round/compressors/utils.py
c67ce4ae
wenhuach21 Update auto_round/formats.py
e2083ee7
wenhuach21 Update auto_round/experimental/apply_rotation_transform.py
46684d3e
wenhuach21 fix
b9281bba
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
63606dbe
wenhuach21 wenhuach21 requested a review from lkk12014402 lkk12014402 45 days ago
wenhuach21 wenhuach21 requested a review from xin3he xin3he 45 days ago
wenhuach21 wenhuach21 requested a review from yiliu30 yiliu30 45 days ago
wenhuach21 wenhuach21 requested a review from WeiweiZhang1 WeiweiZhang1 45 days ago
wenhuach21 wenhuach21 requested a review from n1ck-guo n1ck-guo 45 days ago
wenhuach21 fix
3e44089a
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
490a359a
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
902a8c75
wenhuach21 Apply suggestions from code review
8bee48e9
wenhuach21 fix
5485a20f
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
fd3a253f
wenhuach21
wenhuach21 wenhuach21 requested a review from lvliang-intel lvliang-intel 45 days ago
wenhuach21 revert change
eac3a0f7
wenhuach21 refine
281f037d
wenhuach21 refine mem usage
9ab4454d
wenhuach21
azure-pipelines
wenhuach21 fix ut
0c040ca4
wenhuach21 Merge branch 'main' into hadamard_change
d0584202
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
5b588349
wenhuach21
azure-pipelines
wenhuach21
azure-pipelines
hshen14
hshen14 commented on 2026-04-22
hshen14
hshen14 commented on 2026-04-22
hshen14
hshen14 commented on 2026-04-22
wenhuach21 update
bf7e5060
wenhuach21 Merge branch 'hadamard_change' of https://github.com/intel/auto-round…
bc65bb77
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
653132db
wenhuach21 Merge branch 'main' into hadamard_change
1a2216cc
wenhuach21 fix typo
cc7dbd54
wenhuach21 fix typo
21e6acd1
wenhuach21 rename one env name
1ff6e84d
wenhuach21 fix
f0603bf3
wenhuach21 refine env doc
0c2e5c38
wenhuach21 wenhuach21 changed the title [research feature] inplace hadamard to support INT4 [research feature] support INT4 45 days ago
wenhuach21 wenhuach21 changed the title [research feature] support INT4 [research feature] Introduce INT4 support at the algorithm level 45 days ago
wenhuach21
azure-pipelines
lkk12014402
lkk12014402 approved these changes on 2026-04-22
lkk12014402
wenhuach21
wenhuach21 wenhuach21 merged 11e91869 into main 44 days ago
wenhuach21 wenhuach21 deleted the hadamard_change branch 44 days ago
wenhuach21

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum