PR #3234 llama : store non-RoPEd K cache - SemanticDiff

llama : store non-RoPEd K cache #3234

ggerganov wants to merge 1 commit into custom-attention-mask from custom-attention-mask-no-roped-cache

ggerganov

ggerganov

llama : store non-RoPEd K cache (WIP)

784d14ed

ggerganov

ggerganov added demo

slaren

ggerganov

slaren

ggerganov

ggerganov

ggerganov force-pushed the custom-attention-mask branch from 5bda9e27 to 0161372b 2 years ago

Olexorus

ggerganov

Olexorus

ggerganov

Olexorus

slaren

cmp-nct

Login to write a write a comment.

Login via GitHub

Reviewers

No reviews

Assignees

No one assigned

Labels

demo

Milestone

No milestone