fix(rrq): address PR #2308 review feedback #2626
fix(rrq): address PR #2308 review feedback
a695d84c
fix(rrq): load base in bf16 and avoid OOM on large models
c9c529c1
docs(rrq): add Qwen3.8-27B 2+2+2+2 accuracy and cost report
448293e6
[pre-commit.ci] auto fixes from pre-commit.com hooks
7eaa1401
fix(rrq): address review comments on fallback scope and export buffers
34708ed9
test(rrq): cover incremental residual generation from a real 2-bit base
ba48d194
[pre-commit.ci] auto fixes from pre-commit.com hooks
ac5b7682
perf(rrq): add materialize_rrq and budget-aware weight caching
b61d3aec
docs(rrq): document materialize_rrq and the inference speed trade-off
6dcd9847
perf(rrq): parallelize and GPU-accelerate incremental residual genera…
2aa8e496
docs(rrq): document parallel multi-GPU residual generation
be6a7ddd
docs(rrq): compare RTN vs AutoRound base plane quality
4b4b4b0a
docs(rrq): add per-task deltas and mixed-precision cross-check
1a89c11a
feat(rrq): add phase-dependent precision (6-bit prefill, 2-bit decode)
d19dd2fe
docs(rrq): report GSM8K accuracy for the prefill/decode split
d215da7d
perf(rrq): add fused INT2 GEMV kernel for single-token decode
228d88b7
docs(rrq): document the fused decode kernel
234283f8
docs(rrq): correct the fused kernel numerical characterisation
970a2ac8
perf(rrq): batch the fused decode kernel
80089a18
docs(rrq): report corrected GSM8K accuracy
ffb2ebca
docs(rrq): align CN GSM8K delta with the measured value
87740a85
docs(rrq): report prefill6/decode4 GSM8K accuracy and decode throughput
7c77dbd5
docs(rrq): add the uniform 4-bit control and retract the p6d4 recomme…
8c01d4cf
feat(rrq): let set_rrq_random_residual keep a uniform prefill
575f90d9
feat(rrq): add only= to restrict mixed residual spending to one modul…
a83517e9
docs(rrq): report MATH-500 accuracy and the bf16 lossless reference
93c896ea
docs(rrq): add the commands that produce configurations A and B
4560d165
docs(rrq): measure the tuned-base gain on reasoning benchmarks
140f4e2e
fix(rrq): accept .bin-only raw models in generate_rrq_residual
b0844f95
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub