implement adaptive-p sampler #17927
initial commit for branch
774cf23e
simplify constants
5ab4ff7e
Merge branch 'ggml-org:master' into power-law-sampler
66e2d17c
add params to `struct common_params_sampling`, add reference to PR
88fb0f3f
explicitly clamp `min_target` and `max_target` to `[0.0, 1.0]`
374bfd43
add args, rename `queue_size` -> `window_size`
ffe16391
improved comments
4959878a
minor
f3457a83
remove old unused code from algorithm
93169593
minor
b3aea577
add power law case to `common_sampler_init`, add sampler name mappings
cd7de7c7
clarify behaviour when `window_size = 0`
534cb4fb
add missing enums
dcada035
ddh0
marked this pull request as ready for review 100 days ago
ddh0
marked this pull request as draft 100 days ago
remove `target_range` param, make `target == 1` no-op, cleanup code
2d62bbea
oops, straggler
5c78b792
pnb
commented
on 2025-12-12
add missing parameters in `server-task.cpp`
53380c18
copy from author
94cb883e
remove old debug log, style nit
0a19a3fd
fix compiler warning, add commented-out logging per token
824bb3aa
Merge branch 'ggml-org:master' into power-law-sampler
1879fc6d
Merge branch 'ggml-org:master' into power-law-sampler
67a73367
re-write + change parameters + simplify
a96ddd74
oops forgot args.cpp
b8a9626a
fix leftover `window_size`
965bcc9d
add missing values to `common_params_sampling::print()`
d1e5c604
with logging
9613c481
does this fix it?
2a3f579d
no, but does this?
ec54fe5f
update default decay
667b70fd
Merge branch 'master' into power-law-sampler
36b526d7
optimize
69347806
fix bad merge
f5d08724
silence `missing initializer for member`
493bf301
update default decay to 0.9
68543257
fix logging
b5ed673c
format (double)
4e28eb2f
add power law to the new `samplers` vector
1c58e9a9
ddh0
force pushed
from
778a00ed
to
1c58e9a9
97 days ago
log sampler init values
4e04bd1c
Merge branch 'ggml-org:master' into power-law-sampler
6e66095e
improve logging messages in llama_sampler_power_law
9c50b573
remove extraneous logging
0344068c
simplify target computation
1c2d2e90
Merge branch 'ggml-org:master' into power-law-sampler
85b6e52e
remove debug logging, explicitly clamp params at init
fcb51290
ddh0
marked this pull request as ready for review 96 days ago
Merge branch 'ggml-org:master' into power-law-sampler
58aa1c6f
Merge branch 'ggml-org:master' into power-law-sampler
27dda80d
add `use_power_law` flag + logic, minor cleanup
77529989
Merge branch 'ggml-org:master' into power-law-sampler
60235724
Merge branch 'ggml-org:master' into power-law-sampler
dedbe367
Merge branch 'ggml-org:master' into power-law-sampler
f4703d42
Merge branch 'ggml-org:master' into power-law-sampler
89ebdf00
Merge branch 'ggml-org:master' into power-law-sampler
55ad4a89
Merge branch 'ggml-org:master' into power-law-sampler
6bad4aef
Merge branch 'ggml-org:master' into power-law-sampler
295d1d89
Merge branch 'ggml-org:master' into power-law-sampler
ed2890e6
Merge branch 'ggml-org:master' into power-law-sampler
51070e0d
Merge branch 'ggml-org:master' into power-law-sampler
90f3bfbe
update `power-law` -> `adaptive-p`
b95b0884
ddh0
changed the title implement Power Law sampling implement adaptive-p sampler 85 days ago
Merge branch 'ggml-org:master' into power-law-sampler
f0d3f131
fix cold start EMA
e7a89206
Merge branch 'ggml-org:master' into power-law-sampler
05d7dc9e
Merge branch 'ggml-org:master' into power-law-sampler
2d67b1c0
update `SHARPNESS` constant to `10.0f`
c6a6f635
minor style fixes
08074990
minor style fixes cont.
eb854e73
Merge branch 'ggml-org:master' into power-law-sampler
55757dcb
Merge branch 'ggml-org:master' into power-law-sampler
660a3b27
Merge branch 'ggml-org:master' into power-law-sampler
7173e84e
update `llama_sampler_adaptive_p_i` for backend sampling (ref: #17004)
c27df510
Merge branch 'ggml-org:master' into power-law-sampler
5fdc5307
Merge branch 'ggml-org:master' into power-law-sampler
0400611a
Merge branch 'ggml-org:master' into power-law-sampler
684c5ff0
Merge branch 'ggml-org:master' into power-law-sampler
7ffd3a8c
Merge branch 'ggml-org:master' into power-law-sampler
f48413c8
separate into `apply` + `accept` functions
bef75d90
Merge branch 'ggml-org:master' into power-law-sampler
8b1292a9
`pending_token_idx`: switch from `llama_token` to `int32`
e99a4a66
Merge branch 'ggml-org:master' into power-law-sampler
af0596c2
Merge branch 'ggml-org:master' into power-law-sampler
5f04265d
Merge branch 'ggml-org:master' into power-law-sampler
7f409285
don't transform logits <= -1e9f
3aa23f3f
Merge branch 'ggml-org:master' into power-law-sampler
1eff502d
fix masking in backend top-p, min-p
d21c87ea
Merge branch 'ggml-org:master' into power-law-sampler
4b92e3aa
ggerganov
approved these changes
on 2026-01-14
address review comments
33c635e0
typo in comments `RND` -> `RNG`
4b06e083
add docs
42af39d6
add recommended values in completion docs
81af54c6
address PR feedback
40fd48f5
remove trailing whitespace (for CI `editorconfig`)
b6041b10
timwu
commented
on 2026-01-15
Merge branch 'ggml-org:master' into power-law-sampler
f222e175
add to adaptive-p to `common_sampler_types_from_chars`
d7e3b866
ggerganov
merged
13f1e4a9
into master 66 days ago
ddh0
deleted the power-law-sampler branch 29 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub