Add support for including in-memory videos (not just files/urls) in apply_chat_template #39494
akibjawad
marked this pull request as draft 1 year ago
akibjawad
force pushed
from
7316ddce
to
7e0880be
1 year ago
akibjawad
force pushed
from
7e0880be
to
a3d74ed4
1 year ago
akibjawad
force pushed
from
763e1b16
to
404d0fe5
1 year ago
akibjawad
force pushed
from
404d0fe5
to
28f6fe07
1 year ago
akibjawad
force pushed
from
5b861f5c
to
971dabae
1 year ago
akibjawad
force pushed
from
dacb18ed
to
c203e9f6
1 year ago
akibjawad
changed the title [WIP] Add support for including video object in apply_chat_template function [WIP] Add support for including in-memory videos (not just files/urls) in apply_chat_template 1 year ago
akibjawad
marked this pull request as ready for review 1 year ago
akibjawad
changed the title [WIP] Add support for including in-memory videos (not just files/urls) in apply_chat_template Add support for including in-memory videos (not just files/urls) in apply_chat_template 1 year ago
akibjawad
force pushed
from
c203e9f6
to
543da85b
1 year ago
akibjawad
force pushed
from
543da85b
to
7067f68a
1 year ago
akibjawad
force pushed
from
7067f68a
to
9d1a5017
1 year ago
akibjawad
force pushed
from
9d1a5017
to
0ee3bdbc
1 year ago
akibjawad
force pushed
from
0ee3bdbc
to
f2855b04
1 year ago
akibjawad
force pushed
from
f2855b04
to
c7142ea6
1 year ago
akibjawad
force pushed
from
c7142ea6
to
b4b905e5
1 year ago
akibjawad
force pushed
from
b4b905e5
to
03e400b8
1 year ago
akibjawad
force pushed
from
03e400b8
to
ef6ce1f6
1 year ago
akibjawad
force pushed
from
377acc90
to
cf3df356
1 year ago
akibjawad
force pushed
from
cf3df356
to
08612aab
1 year ago
added code for handling video object ,as dictionary of frames and met…
289376ef
added new test where videos are passed as objects (dict of frames, me…
cec5f3c8
modified hardcoded video_len check that does not match with increased…
d6993984
Modify hardcoded video_len check that fails with increased number of …
6895aaf1
update documentation of multi-modal chat templating with extra inform…
f79d0d8b
add array handling in load_video()
e9f95d33
temporary test video inlcuded
410c812b
skip testing smolvlm with videos that are list of frames
09318d8c
update documentation & make fixup
8719706b
Address review comments
db06f5ba
akibjawad
force pushed
from
7429b309
to
db06f5ba
1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub