auto-round
Delay materializing the replaced model weights until quantization
#1307
Merged
Overview
Commits
61
Changes
View On GitHub

Delay materializing the replaced model weights until quantization #1307

yiliu30 merged 61 commits into main from lazy-replace
yiliu30
yiliu30 refine replacement logic
e337b226
yiliu30 refine gpt-oss
48f12731
yiliu30 enhance memory monitor
7e5a9d7b
yiliu30 fix
23334a00
yiliu30 update replace logic
d87613bb
yiliu30 fix
0111ae43
yiliu30 clean
3379e6ff
yiliu30 fix
21ca1e48
yiliu30 refine name
2e8b438b
yiliu30 refactor ds
2ba764c6
yiliu30 fix
bfe8f884
yiliu30 refactor llama4
8e0c98f5
yiliu30 add note
56119be7
yiliu30 revert test change
f8bc90b2
yiliu30 yiliu30 marked this pull request as ready for review 250 days ago
yiliu30 yiliu30 requested a review from copilot-pull-request-reviewer copilot-pull-request-reviewer 250 days ago
wenhuach21
wenhuach21 commented on 2026-01-21
copilot-pull-request-reviewer
copilot-pull-request-reviewer commented on 2026-01-21
wenhuach21
yiliu30 merge main
b3610d71
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
43db8151
yiliu30
yiliu30 commented on 2026-01-21
yiliu30
yiliu30 commented on 2026-01-21
yiliu30 add utils
37ccbeae
yiliu30 Merge branch 'lazy-replace' of https://github.com/intel/auto-round in…
cefb707f
yiliu30 fix
e2ae147e
yiliu30 Merge branch 'main' into lazy-replace
4efcd4d9
yiliu30 fix
eac43657
yiliu30 Merge branch 'lazy-replace' of https://github.com/intel/auto-round in…
c64ede0e
yiliu30 fix cpu ut
48a9c600
yiliu30 add safe to cpu
69a9e207
yiliu30 tmp debug
299f3026
yiliu30 Merge branch 'main' into lazy-replace
7f00ed49
yiliu30 fix llama
3e0e8c08
yiliu30 Merge branch 'lazy-replace' of https://github.com/intel/auto-round in…
efd931dc
yiliu30 quick fix
ba559bf1
yiliu30 Merge branch 'main' into lazy-replace
57313011
yiliu30 fix
d2c59960
yiliu30 Merge branch 'lazy-replace' of https://github.com/intel/auto-round in…
bafa5f63
yiliu30 update
0ae01b5c
yiliu30 merge main
8e026922
yiliu30 fix
a41b69ab
yiliu30 fix
2ad016ad
yiliu30 fix
bfde825b
yiliu30 clean code
ab22a915
yiliu30 clean code
41ade145
yiliu30 update
b98982c0
yiliu30 fix
4c9e59ee
yiliu30 add more mem logger
23661c03
yiliu30 fix format
aa129668
yiliu30 revert clean module name
f6d39cf3
yiliu30 refactor models
00279431
yiliu30 format
18043c58
yiliu30 fix ds
9d00eb7b
yiliu30 clean
c7bec548
yiliu30 clean
ae893c54
yiliu30 update note
f4e5c7f6
yiliu30 yiliu30 requested a review from wenhuach21 wenhuach21 248 days ago
yiliu30 yiliu30 requested a review from n1ck-guo n1ck-guo 248 days ago
yiliu30 yiliu30 requested a review from mengniwang95 mengniwang95 248 days ago
wenhuach21
wenhuach21 commented on 2026-01-23
wenhuach21
wenhuach21 commented on 2026-01-23
yiliu30 Merge branch 'main' into lazy-replace
87677d09
yiliu30 Merge branch 'lazy-replace' of https://github.com/intel/auto-round in…
20ce9fb9
yiliu30 global state
5b4a2c92
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
5b97021c
yiliu30 fix imatrix
c7181ebb
yiliu30 Merge branch 'main' into lazy-replace
c0860152
yiliu30 fix
59b9ab92
yiliu30 update
81cb1525
yiliu30 yiliu30 requested a review from wenhuach21 wenhuach21 248 days ago
yiliu30 Merge branch 'main' into lazy-replace
f9f139df
yiliu30 add safe to cpu
ab05f4d9
yiliu30 fix ut
e80fe994
wenhuach21
wenhuach21 approved these changes on 2026-01-26
yiliu30 yiliu30 merged d9d20a12 into main 245 days ago
yiliu30 yiliu30 deleted the lazy-replace branch 245 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum