llama.cpp
speculative : refactor and add a simpler example
#10362

Merged

speculative : refactor and add a simpler example #10362

ggerganov merged 14 commits into master from gg/speculative-refactor

ggerganov added demo

github-actions added examples

ggerganov force pushed 1 year ago

ggerganov force pushed to 74221ef6 1 year ago

speculative : refactor and add a simpler example

71fc16bb

speculative : clean-up and add comments and TODOs [no ci]

fe043ff1

ggerganov force pushed from 74221ef6 to fe043ff1 1 year ago

speculative : manage context in common_speculative

0f878a65

github-actions added server

speculative : simplify

e4c122b9

ggerganov force pushed to e4c122b9 1 year ago

speculative : simplify (cont)

0d4d0c15

speculative : add --draft-min CLI arg

f27ddc57

speculative : minor fixup

ccc8f63f

github-actions added testing

ggerganov marked this pull request as ready for review 1 year ago

make : build fixes

2e197a1f

speculative : do not redraft previous drafts

be5f6110

speculative : fix the draft sampling

d9fb3b2e

speculative : fix compile warning

c8880e78

common : refactor args

7f9cc205

common : change defaults [no ci]

4eb126ff

ggerganov removed demo

common : final touches

8f419181

ggerganov merged d9d54e49 into master 1 year ago

ggerganov deleted the gg/speculative-refactor branch 1 year ago

Reviewers

No reviews

Assignees

No one assigned

Labels

testing examples server

Milestone

No milestone

llama.cpp speculative : refactor and add a simpler example #10362 Merged

speculative : refactor and add a simpler example #10362

llama.cpp
speculative : refactor and add a simpler example
#10362

Merged