llama.cpp
Add support for CogVLM model
#15002
Merged

Add support for CogVLM model #15002

ngxson merged 19 commits into ggml-org:master from Tianyue-Zhao:cogvlm_support
Tianyue-Zhao
github-actions github-actions added examples
github-actions github-actions added python
Tianyue-Zhao Tianyue-Zhao marked this pull request as ready for review 141 days ago
Tianyue-Zhao Tianyue-Zhao force pushed 139 days ago
Tianyue-Zhao
CISC
CISC
CISC commented on 2025-08-02
Tianyue-Zhao
Tianyue-Zhao Tianyue-Zhao force pushed 134 days ago
CISC
CISC commented on 2025-08-08
Tianyue-Zhao Tianyue-Zhao force pushed 131 days ago
CISC
CISC commented on 2025-08-18
CISC
CISC
Tianyue-Zhao Added GGUF mappings for CogVLM model
da81af4f
Tianyue-Zhao Add tensor mapping for CogVLM visual encoder
6de9d169
Tianyue-Zhao Add CogVLM to conversion script, no vision part yet
11fac0c0
Tianyue-Zhao Added CogVLM vision model to conversion script
a3adac12
Tianyue-Zhao Add graph for CogVLM CLIP model
30267810
Tianyue-Zhao Add graph for CogVLM
183ca2eb
Tianyue-Zhao Fixes for CogVLM. Now compiles.
ac3e3489
Tianyue-Zhao Model now runs
0634dc94
Tianyue-Zhao Fixes for cogvlm graph
4c080bf5
Tianyue-Zhao Account for graph context change after rebase
bc3f0847
Tianyue-Zhao Changes for whitespace
bcbd6ef4
Tianyue-Zhao Changes in convert script according to comments
c65f5aa9
Tianyue-Zhao Switch CogVLM LLM graph to merged QKV tensor
00af7ee5
Tianyue-Zhao Use rope_type variable instead of direct definition
79e5640c
Tianyue-Zhao Change CogVLM CLIP encoder to use SWIGLU
86a10bc1
Tianyue-Zhao Switch CogVLM CLIP to use merged QKV
a959a1fa
Tianyue-Zhao Apply rebase edits and remove ggml_cont call that is now unnecessary
06a07194
Tianyue-Zhao Tianyue-Zhao force pushed to 06a07194 102 days ago
Tianyue-Zhao
CISC CISC requested a review from ngxson ngxson 101 days ago
ngxson
ngxson Merge branch 'master' into cogvlm_support
f5cb848b
ngxson clean up
85764bd8
ngxson
ngxson approved these changes on 2025-10-29
ngxson
CISC
ngxson ngxson merged bacddc04 into master 50 days ago
ngxson

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone