PR #18042 model: support GLM4V vision encoder

model: support GLM4V vision encoder #18042

ngxson merged 27 commits into ggml-org:master from ngxson:xsn/glm4v

convert ok

b24d366e

no deepstack

7b13c8ea

less new tensors

f3f8fb4b

cgraph ok

4e81ab4b

add mrope for text model

306f342e

faster patch merger

6a6e3017

add GGML_ROPE_TYPE_MRNORM

c78c2e3f

add support for metal

037e76e9

move glm4v do dedicated graph

b4e65dc8

convert: add norm_embd

7d6a1e07

clip: add debugging fn

5047d8ed

working correctly

ad85426e

fix style

f00127e3

use bicubic

1514734c

github-actions added model

github-actions added examples

github-actions added python

github-actions added ggml

github-actions added Apple Metal

fix mrope metal

cadaedbb

improve cpu

4a0b89ab

convert to neox ordering on conversion

d00d11e4

github-actions added testing

revert backend changes

f8aad316

ngxson removed testing

ngxson removed ggml

ngxson removed Apple Metal

force stop if using old weight

87001588

support moe variant

33fb59ab

fix conversion

c8fd94f3

fix convert (2)

785ccf42

ngxson marked this pull request as ready for review 156 days ago

ngxson requested a review from

CISC 156 days ago

ngxson requested a review from

ggerganov 156 days ago

ngxson commented on 2025-12-15

CISC commented on 2025-12-15

ggerganov approved these changes on 2025-12-15

Update tools/mtmd/clip-graph.h

7d53c0f0

Merge branch 'master' into xsn/glm4v

b81c03c5

process mrope_section on TextModel base class

dd66aba5

Merge branch 'master' into xsn/glm4v

35ad5a5c

CISC approved these changes on 2025-12-15

resolve conflict merge

f969d4f6

ngxson merged 3d86c6c2 into master 155 days ago

Reviewers

CISC

ggerganov

Assignees

No one assigned

Labels

model examples python

Milestone

No milestone

llama.cpp model: support GLM4V vision encoder #18042 Merged

model: support GLM4V vision encoder #18042

llama.cpp
model: support GLM4V vision encoder
#18042

Merged