llama.cpp
examples : evaluate tokens in batches after swapping context
#1014

Merged

examples : evaluate tokens in batches after swapping context #1014

ggerganov merged 2 commits into ggml-org:master from grencez:batching

grencez force pushed 2 years ago

grencez changed the title ~~Evaluate tokens in batches after swapping context~~ examples: Evaluate tokens in batches after swapping context 2 years ago

grencez changed the title ~~examples: Evaluate tokens in batches after swapping context~~ examples : evaluate tokens in batches after swapping context 2 years ago

grencez marked this pull request as ready for review 2 years ago

examples : evaluate tokens in batches after swapping context

d1f02102

grencez force pushed to d1f02102 2 years ago

ggerganov approved these changes on 2023-04-21

Update examples/main/main.cpp

80d1c166

ggerganov merged 94112882 into master 2 years ago

grencez deleted the batching branch 2 years ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

llama.cpp examples : evaluate tokens in batches after swapping context #1014 Merged

examples : evaluate tokens in batches after swapping context #1014

llama.cpp
examples : evaluate tokens in batches after swapping context
#1014

Merged