llama.cpp
llama : add attention weights extraction API [EXPERIMENTAL]
#20086

Open

llama : add attention weights extraction API [EXPERIMENTAL] #20086

QuentinFuxa wants to merge 2 commits into ggml-org:master from QuentinFuxa:add-attention-weights-extraction-API--EXPERIMENTAL-

llama : add attention weights extraction API [EXPERIMENTAL]

14bf6d45

Use internal cb_eval for attention extraction to eliminate graph splits

b550fa6e

QuentinFuxa requested a review from

CISC 3 days ago

QuentinFuxa requested a review from

ggerganov 3 days ago

github-actions added examples

github-actions added python

QuentinFuxa force pushed from 472702a8 to 5ac48b06 1 day ago

QuentinFuxa force pushed from 5ac48b06 to e8734acb 1 day ago

QuentinFuxa force pushed from e8734acb to b550fa6e 1 day ago

Reviewers

CISC

ggerganov

Assignees

No one assigned

Labels

examples python

Milestone

No milestone