PR #8473 llama : fix Gemma-2 Query scaling factors

llama : fix Gemma-2 Query scaling factors #8473

ggerganov merged 2 commits into master from gg/gemma-2-fix-q-scale

9B - query_pre_attn_scalar = 256 not 224

df78f196

llama : fix Gemma-2 Query scaling factor

acc877f4

github-actions added python

mofosyne added Review Complexity : Low

ggerganov merged 73cf442e into master 1 year ago

ggerganov deleted the gg/gemma-2-fix-q-scale branch 1 year ago

Reviewers

No reviews

Assignees

No one assigned

Labels

Review Complexity : Low python

Milestone

No milestone