PR #2756 Enable qwen2vl video

drbh force pushed from b780f00e to 6b4697e9 1 year ago

mfarre commented on 2024-11-20

drbh force pushed from b9707b9a to 32438fca 1 year ago

drbh force pushed from 2ef3038d to 17b27d4f 1 year ago

drbh force pushed from 82b0a19c to 65c2d79c 1 year ago

drbh force pushed from a76be979 to 58e24a38 1 year ago

drbh force pushed from be40041e to 4e921bfe 1 year ago

drbh force pushed from 4e921bfe to 93a2413b 1 year ago

WIP video support

18c9f06d

router changes

7c679399

adopting video url

5ced960f

connecting video to qwen2

05464d26

fix

c7c2fdae

downloading videos

b9c8152a

fix

464609fd

refactoring

a25c3ece

fix

3c07391e

feat: support video input chunks and enable qwen2 vl to process video

b2c55759

fix: add protobuf update and mp4parse dep

83a7f185

fix: remove unused deps and imports

322165d7

moving video sampling and resize to validation. downstream we receive…

e65ead12

flatten frames to data block when needed

36e095b3

fix: adjust video process, reduce to 1 fps and adjust tensor shape

bc5e202d

fix: adjust deps after rebase

1afaa69d

feat: adjust impure shell deps and autodocs workflow

16007b68

fix: include more deps for ffmpeg as docs suggest

39fac7ec

fix: add ffmpeg deps to test build

b508b10d

fix: debug ffmpeg install in tests workflow

4a3a7243

fix: debug ffmpeg deps in tests II

ac7483cf

fix: adjust dependencies and bump pip along with python

137f3bb2

fix: adjust pkg config in test

daf83a95

fix: ensure pip is installed after installing deps in test workflow

d5cc6707

fix: add libavfilter dep to test

4a76e8b8

fix: add libavdevice dep to tests workflow

f0c38412

fix: add ffmpeg overlay and enable build

96968a0d

fix: include ffmpeg deps in autodocs workflow

167c6f06

Cleanup impure Nix shell

98392a7a

Make the pure build work

05004a6c

Fix test devshell

063104c2

fix: bump deps in other dockerfiles

2dc078ad

fix: add ffmpeg to final layer of container

50b5399d

fix: include usr lib in ld path

b5b2184c

fix: copy shared libraries from builder

75ab887d

installing ssl requirements prior to rust building stage

cbf1d982

fixing ssl issue

af77a0ca

working version

19e1c8da

cleanup prints

db97d979

fix: pre commit and clippy lints

71ed75a2

fix: resolve rebase issues and add test

e2b75a57

fix: remove unnecessary cast

1d6bf243

fix: update all vlm forward args, pass shared libraries to final laye…

2ae152a1

fix: adjust batch_tokenized_inputs output in mllama

5c7bc91a

fix: update lints after rebase

bb00fb33

fix: update trtllm dockefile after rebase

91ed362e

fix: adjust whitespace lint

5322abd9

fix: feature flag video and remove from non cuda dockerfiles

b4da6ad3

fix: make ffmpeg-next dep optional with feature

27f758de

fix: include the video feature in cargo chef command

4f42d0c7

fix: adjust trtllm looper for video chunk enum

dcc11941

drbh force pushed from 93a2413b to dcc11941 1 year ago

drbh marked this pull request as ready for review 1 year ago

fix: small refactor and cleanups

b27749eb

Narsil commented on 2025-01-15

fix: improve video processing and update unsupported paths

78cd756c

fix: remove test debug params

17192c9a

text-generation-inference
Enable qwen2vl video
#2756

Open

Enable qwen2vl video #2756

text-generation-inference Enable qwen2vl video #2756 Open

Enable qwen2vl video #2756

text-generation-inference
Enable qwen2vl video
#2756

Open