Recurrent Residual Quantization (RRQ) for LLMs #2308
luoyu-intel
wants to merge
44 commits into
main
from
feat/rrq-phase1
lvliang-intel
commented
on 2026-09-09
lvliang-intel
commented
on 2026-09-09
a32543254
approved these changes
on 2026-09-09
a32543254
commented
on 2026-09-09
wenhuach21
commented
on 2026-09-09
wenhuach21
commented
on 2026-09-09
wenhuach21
commented
on 2026-09-09
feat(rrq): Phase 1 - Recurrent Residual Quantization (packed INT2 2+2…
9a1b044a
feat(rrq): Phase 2 - generate_rrq_residual (incremental from existing…
f3af3cad
feat(rrq): Phase 3 - add per-plane sign-SGD tuning
7aec193a
fix(rrq): accumulate optimized residual prefix
5a24a5c0
![pre-commit-ci[bot]](https://avatars.githubusercontent.com/in/68672?v=4&s=60)
[pre-commit.ci] auto fixes from pre-commit.com hooks
b40ab6a4
feat(rrq): match AutoRound per-plane quality + configurable mixed-pre…
9bf7d8d7
docs(rrq): add Recurrent Residual Quantization entry to README
0957d120
[pre-commit.ci] auto fixes from pre-commit.com hooks
fe5fc97b
fix(cli): match shared argparse options before falling back to dest i…
f7d228ea
perf(rrq): replace 4-plane matmul accumulation with single dequant+ma…
fa9a55bb
[pre-commit.ci] auto fixes from pre-commit.com hooks
0a3f5d31
fix(rrq): declare tunable fields as named __init__ params
503204f7
fix(export): include unquantized vision layers in AWQ modules_to_not_…
a8f5fc13
refactor(rrq): minimize common-code changes to preserve main behavior
6b3dc45f
[pre-commit.ci] auto fixes from pre-commit.com hooks
263e841a
revert(export): restore AWQ _collect_modules_to_not_convert to main l…
d822fb96
Apply batched suggestions from code review
1af201b1
revert log info
1aa09505
fix(rrq): raise ValueError for explicit model_free=True with RRQConfig
cac3743d
fix(rrq): enforce disable_opt_rtn=True in RRQConfig.check_config()
e0c29eef
Refactor RRQ exports to sub-package entry points and add eval scripts
87516ac3
test(rrq): add lm-eval accuracy test for RRQ W2A16 quantization
32699b23
[pre-commit.ci] auto fixes from pre-commit.com hooks
f409ccf4
docs(README): note that RRQ does not support production-level deploym…
d44a67c0
feat(rrq): hide RRQ from user-facing listings, auto-select via format
f673c4e5
[pre-commit.ci] auto fixes from pre-commit.com hooks
30381ba5
fix(rrq): auto-select W2A16 scheme and force disable_opt_rtn for RRQ
0189dc8b
[pre-commit.ci] auto fixes from pre-commit.com hooks
fb2634c2
refactor(rrq): remove RRQ from _BUILTIN_ALGORITHM_ORDER
52de3565
refactor(rrq): use quant_method='auto-round' + packing_format='auto_r…
f4aae121
[pre-commit.ci] auto fixes from pre-commit.com hooks
5883f7d5
fix(test): add proper category prefix to skip_ci reason
d95c78a2
wenhuach21
commented
on 2026-09-15
wenhuach21
commented
on 2026-09-15
wenhuach21
commented
on 2026-09-15
wenhuach21
commented
on 2026-09-15
wenhuach21
commented
on 2026-09-15
wenhuach21
approved these changes
on 2026-09-15
fix: normalize Conv1D weight orientation in RRQ quantizer
e5eab0c4
fix: allow save_quantized(format=...) to override constructor-set format
f7fa8c7f
[pre-commit.ci] auto fixes from pre-commit.com hooks
70b09f46
fix(rrq): implement RTN quantization for layers outside transformer b…
fede3a77
[pre-commit.ci] auto fixes from pre-commit.com hooks
39c2e514
yiliu30
approved these changes
on 2026-09-19
fix(rrq): ensure base+residual are both exported via a single save_rr…
7816b9ec
Potential fix for pull request finding
4528e9e3
fix(rrq): default active_bits to max supported by checkpoint
c1007208
[pre-commit.ci] auto fixes from pre-commit.com hooks
34fee7c7
Potential fix for pull request finding
25b8e055
fix(rrq): address PR #2308 review comments
03e92452
[pre-commit.ci] auto fixes from pre-commit.com hooks
027407b7
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub