llama.cpp
server : fix context shift
#5195
Merged

server : fix context shift #5195

ggerganov merged 4 commits into master from gg/server-fix-shift
ggerganov
Green-Sky
Green-Sky
Green-Sky commented on 2024-01-29
Green-Sky
Green-Sky
ggerganov server : fix context shift + simplify self-extend
51bb7f0e
ggerganov server : take system_tokens into account
8772d3ee
ggerganov server : more n_past fixes
d0e10bf1
ggerganov ggerganov force pushed from 5f62e231 to d0e10bf1 1 year ago
ggerganov
Green-Sky
Green-Sky
Green-Sky
Maximilian-Winter
Green-Sky
Maximilian-Winter
ggerganov server : rever n_past_se changes
05350f28
ggerganov ggerganov changed the title server : fix context shift + simplify self-extend server : fix context shift 1 year ago
ggerganov
Maximilian-Winter
ggerganov
ggerganov ggerganov merged e6f291d1 into master 1 year ago
ggerganov ggerganov deleted the gg/server-fix-shift branch 1 year ago
Green-Sky
Green-Sky
nelsonhurstdev
Green-Sky
ristew

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone