llama.cpp
Save and restore prompt evaluation state for much faster startup times
#1169
Merged
Overview
Commits
1
Changes
View On GitHub

Save and restore prompt evaluation state for much faster startup times #1169

ggerganov merged 1 commit into ggml-org:master from ejones:master
ejones
ejones llama : add session file format and saved sessions in main
7f58f2cc
ejones ejones changed the title Add saved sessions for near-instant startup on long prompts Save and restore prompt evaluation state for much faster startup times 2 years ago
mishudark
ejones
ggerganov ggerganov added enhancement
ggerganov ggerganov added high priority
dmahurin
ejones
mikeggh
Priestru
ggerganov
ggerganov approved these changes on 2023-04-28
ggerganov ggerganov merged 1481a9cf into master 2 years ago
ejones
syl-00110111

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
enhancement high priority
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum