transformers
2a9febd6 - Add support for including in-memory videos (not just files/urls) in apply_chat_template (#39494)

Commit
292 days ago
Add support for including in-memory videos (not just files/urls) in apply_chat_template (#39494) * added code for handling video object ,as dictionary of frames and metadata, in chat template * added new test where videos are passed as objects (dict of frames, metadata) in the chat template * modified hardcoded video_len check that does not match with increased number of tests cases. * Modify hardcoded video_len check that fails with increased number of tests * update documentation of multi-modal chat templating with extra information about including video object in chat template. * add array handling in load_video() * temporary test video inlcuded * skip testing smolvlm with videos that are list of frames * update documentation & make fixup * Address review comments
Author
Parents
Loading