PR #8227 gemma2: add sliding window mask

gemma2: add sliding window mask #8227

ngxson merged 10 commits into ggml-org:master from ngxson:xsn/gemma2_mask_swa

gemma2: add sliding window mask

7df7530b

ngxson added help wanted

slaren commented on 2024-06-30

fix data_swa uninitialized

ab2c3de9

better naming

46b56e67

github-actions added python

add co-author

231dae4f

ngxson requested a review from

slaren 1 year ago

ngxson requested a review from

ggerganov 1 year ago

ngxson marked this pull request as ready for review 1 year ago

slaren commented on 2024-06-30

replace list with single tensor

d09ecb84

slaren commented on 2024-06-30

ggerganov commented on 2024-07-01

update

ed5496fb

slaren approved these changes on 2024-07-01

llama : minor styling

ce711f6e

ggerganov approved these changes on 2024-07-01

convert : add sanity check for query_pre_attn_scalar

7dc9cbf0

Merge branch 'master' into xsn/gemma2_mask_swa

80bdc38e

fix small typo in README

e24328ea

ngxson added merge ready

ngxson merged 49122a87 into master 1 year ago

Reviewers

ggerganov

slaren

qnixsynapse

Assignees

No one assigned

Labels

help wanted python merge ready

Milestone

No milestone

llama.cpp gemma2: add sliding window mask #8227 Merged

gemma2: add sliding window mask #8227

llama.cpp
gemma2: add sliding window mask
#8227

Merged