Unverified Commit b99ca4d2 authored by Yoni Gozlan's avatar Yoni Gozlan Committed by GitHub
Browse files

Add support for OpenAI api "image_url" input in chat for image-text-to-text pipeline (#34562)

* add support for openai api image_url input

* change continue to elif

* Explicitely add support for OpenAI/TGI chat format

* rewrite content to transformers chat format and add tests

* Add support for typing of image type in chat templates

* add base64 to possible image types

* refactor nesting
parent 15dd625a
Showing with 70 additions and 10 deletions
+70 -10
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment