llama.cpp
Add Gemma3n multimodal support with MobileNetV5 vision encoder
#18256
Merged

Add Gemma3n multimodal support with MobileNetV5 vision encoder #18256

simrnsingh
simrnsingh Add Gemma3nVisionModel - MobileNetV5 vision encoder convertor to conv…
3e4c8f8f
simrnsingh Add mobilenetv5 impl
ad5ed98d
simrnsingh Fix comments, remove unused vars
f5770547
simrnsingh Fix permute and remove transpose of projection weights
4589d3eb
simrnsingh Merge branch 'master' into feat-gemma3n-vision
28d39cb1
simrnsingh Fix comments, remove debugging prints from hf_to_gguf
47423a29
simrnsingh simrnsingh requested a review from ngxson ngxson 67 days ago
simrnsingh simrnsingh requested a review from CISC CISC 67 days ago
github-actions github-actions added model
github-actions github-actions added examples
github-actions github-actions added python
ngxson
CISC
ngxson
simrnsingh
ngxson
ngxson requested changes on 2025-12-21
simrnsingh 1. Hard-code image_mean = 0 and image_std = 1
67801e5b
simrnsingh 1. Move mobilenetv5 helpers declarations to `clip_graph_mobilenetv5` …
04947c7f
simrnsingh
simrnsingh simrnsingh requested a review from ngxson ngxson 66 days ago
simrnsingh Remove obsolete comments
86618c7c
ngxson
ngxson requested changes on 2025-12-22
ngxson ngxson assigned ngxson ngxson 65 days ago
simrnsingh
ngxson
ngxson requested changes on 2025-12-23
simrnsingh - convert_hf_to_gguf.py & constants.py & tensor_mapping.py: Use expli…
e2835e9f
simrnsingh - Rename tensors to v.conv..., v.blk..., v.msfa... to better align wi…
632e29f5
simrnsingh simrnsingh requested a review from ngxson ngxson 61 days ago
simrnsingh
ngxson
ngxson requested changes on 2025-12-26
simrnsingh Fix stem conv bias name
d37c22b2
ngxson
ngxson commented on 2025-12-26
simrnsingh Remove explicit handling of bias term for stem conv
58667f50
simrnsingh - Change order of addition in "project_per_layer_inputs" to support b…
47b7dd13
simrnsingh simrnsingh requested a review from ngxson ngxson 60 days ago
ngxson Merge branch 'master' into feat-gemma3n-vision
465e888c
ngxson clean up conversion script
eea58817
ngxson fix code style
bfbb3158
ngxson also preserve audio tensors
395d2d41
ngxson trailing space
6a68b35e
ngxson split arch A and V
e842b931
ngxson rm unused gemma3 func
8f6dbbe4
ngxson fix alignment
60c23c9a
ngxson
ngxson approved these changes on 2026-01-09
ngxson ngxson merged a61c8bc3 into master 47 days ago
ggerganov
ggerganov commented on 2026-01-10

Login to write a write a comment.

Login via GitHub

Assignees
Labels
Milestone