Granite Vision Support #35579
ArthurZucker
merged
12 commits into
huggingface:main
from
alex-jw-brooks:mm_granite
alex-jw-brooks
commented
on 2025-01-13
Add multimodal granite support
1e421d99
Remove failing validation for visual encoders with no cls
a638cc3a
Update llava based models / configs to support list of feature layers
fbc9b967
Add tests for multiple feature layers
45825a51
Use conditional instead of except for misaligned feature shapes
35719872
crop cls from each hidden state
bed7d9c8
Fix formatting
583a1555
Support single vision feature int in vipllava
4fa477bd
zucchini-nlp
approved these changes
on 2025-01-14
Fix typo in vision feature selection strategy validation
ff35b37a
ArthurZucker
commented
on 2025-01-20
Add tentative integration test for granite vision models
c9616629
Add granite vision docs
bfd61669
ArthurZucker
approved these changes
on 2025-01-23
Use image url in granitevision example
d77eed78
Reviewers
Assignees
No one assigned
Labels
New model
Multimodal
Milestone
No milestone
Login to write a write a comment.
Login via GitHub