transformers
Capture only the projected hidden states in VLM feature extraction
#49594
Merged
Overview
Commits
19
Changes
View On GitHub

Capture only the projected hidden states in VLM feature extraction #49594

ydshieh merged 19 commits into huggingface:main from hmellor:vlm-capture-selected-hidden-states
hmellor
hmellor Capture only the projected hidden states in VLM feature extraction
9a6affe1
hmellor hmellor force pushed from 6169de7b to 9a6affe1 26 days ago
HuggingFaceDocBuilderDev
hmellor Capture only the needed hidden states in CLIPSeg and PE audio/video
f8ff116f
hmellor hmellor requested a review from vasqu vasqu 26 days ago
hmellor hmellor removed review request from vasqu vasqu 26 days ago
hmellor hmellor requested a review from zucchini-nlp zucchini-nlp 26 days ago
hmellor hmellor requested a review from vasqu vasqu 26 days ago
bakoorahnin
molbap
molbap commented on 2026-10-14
molbap
molbap commented on 2026-10-14
hmellor Index selective hidden-state capture like the full hidden states
8ebd7295
zucchini-nlp
zucchini-nlp commented on 2026-10-15
hmellor Merge branch 'main' into vlm-capture-selected-hidden-states
8200d6ea
hmellor comments
88c2d74a
github-actions
vasqu
hmellor Resolve hidden state indices from the config
8f696e13
hmellor Merge branch 'main' into vlm-capture-selected-hidden-states
23d21f66
hmellor Read output_hidden_states from kwargs in Aria and regenerate Mistral …
68852110
vasqu
vasqu commented on 2026-11-04
hmellor `num_layers_key` -> `num_hidden_layers_key`
06e48cfe
hmellor `_hidden_states_selection` -> `_hidden_states_layers`
ab5008ba
hmellor `_selected_hidden_states` -> `selected_hidden_states`
527c2155
zucchini-nlp
zucchini-nlp approved these changes on 2026-11-05
github-actions
hmellor Move hidden state append helper next to the output capturing hook
64991831
hmellor Check for negative index support up front in the hidden states test
32a0a5f3
hmellor Simplify the feature hidden states test check
af562c04
vasqu
vasqu approved these changes on 2026-11-06
hmellor Add select_hidden_states decorator and drop the plural vision_feature…
f681dc4e
vasqu
vasqu commented on 2026-11-06
vasqu
vasqu commented on 2026-11-06
hmellor Fail with a message when requested hidden states are missing
2155cc5b
hmellor Keep auto_docstring last and use select_hidden_states in CLIPSeg
d5fdef02
hmellor Narrow the select_hidden_states selection with isinstance
d6c2480f
vasqu
vasqu approved these changes on 2026-11-06
hmellor Remove the None kwargs filter from get_image_features
c476dcfd
github-actions
hmellor
github-actions
ydshieh
ydshieh ydshieh merged c5bd76ec into main 3 days ago
hmellor hmellor deleted the vlm-capture-selected-hidden-states branch 3 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum