llama.cpp
Support glm3 and glm4.
#8031
Merged
Overview
Commits
39
Changes
View On GitHub

Support glm3 and glm4. #8031

ggerganov merged 39 commits into ggml-org:master from youth123:master
youth123
xingxingqiao add chatglm3-6b model support huggingface model:
6630a2da
xingxingqiao remove .rotary_pos_emb.inv_freq and unuse code for chatglm3 model
5a914ffc
xingxingqiao fix lint error
f626b717
xingxingqiao optimize convert-hf-to-gguf.py for chatglm model
f3bc337f
xingxingqiao support glm-4-9b-chat
1fc5bf5b
youth123 fix eos tokens to glm4
8c5f1b2b
youth123 remove unused log
95fd910d
youth123 Fix eos tokens to glm4 and adapts to glm3
e7731740
github-actions github-actions added testing
github-actions github-actions added python
xunkai55
youth123 youth123 marked this pull request as draft 1 year ago
youth123 youth123 marked this pull request as ready for review 1 year ago
matteoserva
matteoserva commented on 2024-06-20
arch-btw
youth123
youth123 add preprocess to chatglm3 and chatglm4
4b65b648
arch-btw
mofosyne mofosyne added Review Complexity : Medium
ngxson
ngxson commented on 2024-06-22
ngxson
ngxson commented on 2024-06-22
ngxson
ngxson commented on 2024-06-22
youth123 add eos_id_list to llama.cpp
3a4d5790
github-actions github-actions added examples
github-actions github-actions added server
youth123 fix conflicts
95708067
youth123 fix code style
3b67ff80
youth123 fix code style
5f8f465d
youth123 fix conflicts
f8d4fc98
youth123 fix conflicts
a67bc8f5
youth123 Merge branch 'glm_support'
35579448
ggerganov
ggerganov commented on 2024-06-25
youth123 Revert "add eos_id_list to llama.cpp"
89e8aaf9
matteoserva
youth123
dranger003
youth123 set <|endoftext|> as eos and <|user|> as eot
9396c7bb
youth123 Merge remote-tracking branch 'offical/master'
e18a5365
youth123 fix chat template bug
0595f03d
youth123 youth123 force pushed from 5bbd9c6f to 0595f03d 1 year ago
ngxson
ngxson commented on 2024-06-26
arch-btw
gabrielpondc
gabrielpondc approved these changes on 2024-06-27
gabrielpondc
gabrielpondc commented on 2024-06-27
youth123 add comment to glm prefix and suffix
7357273e
youth123 Merge remote-tracking branch 'offical/master'
1dc8e910
youth123
youth123 fix conflicts and add rope_ratio & ChatGLMForConditionalGeneration
e9e47eb9
youth123 merge master
482bdeaa
youth123 fix chat template bug
bbe1926f
ngxson
ngxson commented on 2024-06-28
jamfor999
jamfor999 approved these changes on 2024-06-29
touale
Forevery1
youth123
youth123 fix codestyle
d07f0a90
youth123 merge master
0d3a94a6
youth123 fix conflicts
5e9dba66
youth123
youth123 modified the general name of glm model
865dd03f
ggerganov
ggerganov commented on 2024-07-01
ggerganov
ggerganov commented on 2024-07-01
Forevery1
youth123 Merge remote-tracking branch 'offical/master'
71c8e024
youth123 merge master
ec89d06f
youth123 fix conflicts
80b381b9
youth123 remove prefix and suffix
bf54db21
youth123 use normal glm4 chattempalte & use LLM_FFN_SWIGLU in phi3
bce74d82
chuangfengwang
ggerganov
ggerganov approved these changes on 2024-07-05
Umpire2018 fix: resolve Flake8 errors in `convert-hf-to-gguf.py`
3be4270f
youth123 Merge pull request #2 from Umpire2018/fix/flake8-error
ed54a65d
youth123 fix rope ratio to solve incorrect answers
5b760f26
youth123 merge master
223eb187
youth123
ggerganov
ggerganov commented on 2024-07-07
youth123 fix by comments
4e85b06d
ggerganov ggerganov merged 905942ab into master 1 year ago
CsBoBoNice
chuangfengwang
youth123
yesmycar
CsBoBoNice
taozhiyuai
chuangfengwang
icetech233
TonloOO
hp027
JG-Adams
ggerganov
JG-Adams
tobias-varden
JG-Adams
Sakura4036
piDack

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
testing examples python Review Complexity : Medium server
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum