transformers
Add support for including in-memory videos (not just files/urls) in apply_chat_template
#39494
Merged

Add support for including in-memory videos (not just files/urls) in apply_chat_template #39494

akibjawad
akibjawad akibjawad marked this pull request as draft 334 days ago
Rocketknight1
akibjawad akibjawad force pushed from 7316ddce to 7e0880be 331 days ago
akibjawad akibjawad force pushed from 7e0880be to a3d74ed4 324 days ago
akibjawad akibjawad force pushed from 763e1b16 to 404d0fe5 323 days ago
akibjawad akibjawad force pushed from 404d0fe5 to 28f6fe07 323 days ago
akibjawad akibjawad force pushed from 5b861f5c to 971dabae 323 days ago
akibjawad akibjawad force pushed from dacb18ed to c203e9f6 323 days ago
akibjawad akibjawad changed the title [WIP] Add support for including video object in apply_chat_template function [WIP] Add support for including in-memory videos (not just files/urls) in apply_chat_template 323 days ago
akibjawad akibjawad marked this pull request as ready for review 323 days ago
github-actions github-actions requested a review from ArthurZucker ArthurZucker 323 days ago
github-actions github-actions requested a review from Rocketknight1 Rocketknight1 323 days ago
akibjawad akibjawad changed the title [WIP] Add support for including in-memory videos (not just files/urls) in apply_chat_template Add support for including in-memory videos (not just files/urls) in apply_chat_template 323 days ago
akibjawad akibjawad force pushed from c203e9f6 to 543da85b 322 days ago
akibjawad akibjawad force pushed from 543da85b to 7067f68a 322 days ago
akibjawad akibjawad force pushed from 7067f68a to 9d1a5017 322 days ago
akibjawad akibjawad force pushed from 9d1a5017 to 0ee3bdbc 322 days ago
akibjawad akibjawad force pushed from 0ee3bdbc to f2855b04 322 days ago
akibjawad akibjawad force pushed from f2855b04 to c7142ea6 322 days ago
akibjawad
zucchini-nlp
zucchini-nlp commented on 2025-07-30
akibjawad akibjawad force pushed from c7142ea6 to b4b905e5 321 days ago
akibjawad
zucchini-nlp
akibjawad akibjawad force pushed from b4b905e5 to 03e400b8 320 days ago
akibjawad akibjawad force pushed from 03e400b8 to ef6ce1f6 320 days ago
akibjawad
akibjawad akibjawad force pushed from 377acc90 to cf3df356 320 days ago
zucchini-nlp
zucchini-nlp commented on 2025-08-01
akibjawad akibjawad force pushed from cf3df356 to 08612aab 320 days ago
akibjawad
akibjawad added code for handling video object ,as dictionary of frames and met…
289376ef
akibjawad added new test where videos are passed as objects (dict of frames, me…
cec5f3c8
akibjawad modified hardcoded video_len check that does not match with increased…
d6993984
akibjawad Modify hardcoded video_len check that fails with increased number of …
6895aaf1
akibjawad update documentation of multi-modal chat templating with extra inform…
f79d0d8b
akibjawad add array handling in load_video()
e9f95d33
akibjawad temporary test video inlcuded
410c812b
akibjawad skip testing smolvlm with videos that are list of frames
09318d8c
akibjawad update documentation & make fixup
8719706b
akibjawad Address review comments
db06f5ba
akibjawad akibjawad force pushed from 7429b309 to db06f5ba 318 days ago
github-actions
zucchini-nlp
zucchini-nlp approved these changes on 2025-08-04
HuggingFaceDocBuilderDev
zucchini-nlp zucchini-nlp merged 2a9febd6 into main 317 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone