llama.cpp
speculative : refactor and add a simpler example
#10362

Merged

speculative : refactor and add a simpler example #10362

ggerganov merged 14 commits into master from gg/speculative-refactor

ggerganov added demo

github-actions added examples

ggerganov force pushed from d415bfb4 to 60e360c1 294 days ago

ggerganov force pushed from 60e360c1 to 097dfd1e 294 days ago

ggerganov force pushed from 097dfd1e to 96b1c3ba 294 days ago

ggerganov force pushed from 96b1c3ba to 74221ef6 294 days ago

speculative : refactor and add a simpler example

71fc16bb

speculative : clean-up and add comments and TODOs [no ci]

fe043ff1

ggerganov force pushed from 74221ef6 to fe043ff1 291 days ago

speculative : manage context in common_speculative

0f878a65

github-actions added server

speculative : simplify

e4c122b9

ggerganov force pushed from dbc7ac58 to e4c122b9 290 days ago

speculative : simplify (cont)

0d4d0c15

speculative : add --draft-min CLI arg

f27ddc57

speculative : minor fixup

ccc8f63f

github-actions added testing

ggerganov marked this pull request as ready for review 290 days ago

make : build fixes

2e197a1f

speculative : do not redraft previous drafts

be5f6110

speculative : fix the draft sampling

d9fb3b2e

speculative : fix compile warning

c8880e78

common : refactor args

7f9cc205

common : change defaults [no ci]

4eb126ff

ggerganov removed demo

common : final touches

8f419181

ggerganov merged d9d54e49 into master 287 days ago

ggerganov deleted the gg/speculative-refactor branch 287 days ago

Reviewers

No reviews

Assignees

No one assigned

Labels

testing examples server

Milestone

No milestone

llama.cpp speculative : refactor and add a simpler example #10362 Merged

speculative : refactor and add a simpler example #10362

llama.cpp
speculative : refactor and add a simpler example
#10362

Merged