transformers
Add support for OpenAI api "image_url" input in chat for image-text-to-text pipeline
#34562

Merged

Add support for OpenAI api "image_url" input in chat for image-text-to-text pipeline #34562

yonigozlan merged 8 commits into huggingface:main from yonigozlan:add-imsupport-openai-chat-in-image-text-to-text-pipeline

yonigozlan requested a review from

zucchini-nlp 1 year ago

zucchini-nlp commented on 2024-11-04

yonigozlan force pushed 1 year ago

yonigozlan requested a review from

ArthurZucker 1 year ago

yonigozlan removed review request from

ArthurZucker 1 year ago

yonigozlan force pushed 1 year ago

yonigozlan requested a review from

ArthurZucker 1 year ago

yonigozlan requested a review from

zucchini-nlp 1 year ago

add support for openai api image_url input

c92e2a45

change continue to elif

7a19a060

Explicitely add support for OpenAI/TGI chat format

13a39cff

rewrite content to transformers chat format and add tests

bec7dc05

Add support for typing of image type in chat templates

b30adf8a

yonigozlan force pushed to b30adf8a 1 year ago

zucchini-nlp commented on 2024-11-19

zucchini-nlp approved these changes on 2024-11-19

add base64 to possible image types

903c30ad

ArthurZucker approved these changes on 2024-11-19

refactor nesting

e8314782

Merge branch 'main' into add-imsupport-openai-chat-in-image-text-to-t…

1ba15fdf

yonigozlan merged b99ca4d2 into main 1 year ago

Reviewers

ArthurZucker

zucchini-nlp

Assignees

No one assigned

Labels

None yet

Milestone

No milestone