PR #3400 llama : fix session saving/loading

llama : fix session saving/loading

ggerganov committed 2 years ago

Merge branch 'master' into fix-sessions

ggerganov committed 2 years ago

llama : temp fix for clearing "future" tokens from the KV cache

ggerganov committed 2 years ago

llama : fix handling of "future" tokens when loading sessions

ggerganov committed 2 years ago

llama : fix comments for llama_kv_cache API

ggerganov committed 2 years ago

llama.cpp llama : fix session saving/loading #3400 Merged