llama.cpp
graph : normalize Q, K, V shapes and add comments
#12449

Merged

graph : normalize Q, K, V shapes and add comments #12449

ggerganov merged 3 commits into master from gg/graph-normalize-qkv-shapes

graph : normalize Q, K, V shapes and add comments

0b795562

ggerganov commented on 2025-03-18

ggerganov requested a review from

fairydreaming 279 days ago

fairydreaming approved these changes on 2025-03-18

context : synchronize before getting cross attention data

8d89dece

model : fix command-r attention norm check

a745e6a1

ggerganov merged 75422e8b into master 279 days ago

ggerganov deleted the gg/graph-normalize-qkv-shapes branch 279 days ago

Reviewers

fairydreaming

Assignees

No one assigned

Labels

None yet

Milestone

No milestone