Commits · 3b3ebcec4077f124f2cd0ec3cd5d028dc352a3e5 · zhusg / transformers-new

27 May, 2025 24 commits

Updated model card for OLMo2 (#38394) · 3b3ebcec

Andy Vu authored 4 weeks ago


* Updated OLMo2 model card

* added command line

* Add suggestions

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Added suggestions

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Indented code block as per suggestions

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

3b3ebcec

Falcon-H1 - Fix auto_docstring and add can_return_tuple decorator (#38260) · f5307272
Yoni Gozlan authored 4 weeks ago
```
Fix auto_docstring and add can_return_tuple
```
f5307272

Update granite.md (#37791) · a092f6ba

Tanuj Rai authored 4 weeks ago


* Update granite.md

* Update docs/source/en/model_doc/granite.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/granite.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/granite.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* update granite.md

* Update docs/source/en/model_doc/granite.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/granite.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/granite.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/granite.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/granite.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/granite.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* minor fixes

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

a092f6ba

New bart model card (#37858) · be7aa321

RogerSinghChugh authored 4 weeks ago


* Modified BART documentation wrt to issue #36979.

* Modified BART documentation wrt to issue #36979.

* fixed a typo.

* Update docs/source/en/model_doc/bart.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bart.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bart.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bart.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bart.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bart.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* blank commit.

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

be7aa321

Updated BERTweet model card. (#37981) · 587c1b0e

RogerSinghChugh authored 4 weeks ago


* Updated BERTweet model card.

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* updated toctree (EN).

* Updated BERTweet model card.

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* updated toctree (EN).

* Updated BERTweet model card.

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/bertweet.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* updated toctree (EN).

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

587c1b0e

Updated BigBird Model card as per #36979. (#37959) · b73faef5

RogerSinghChugh authored 4 weeks ago


* Updated BigBird Model card as per #36979.

* Update docs/source/en/model_doc/big_bird.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/big_bird.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/big_bird.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* Update docs/source/en/model_doc/big_bird.md

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

---------

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

b73faef5

Updated Zoedepth model card (#37898) · 538e847c

Madhav Kumar authored 4 weeks ago

* Edited zoedepth model card according to specifications.

* Edited Zoedepth model file

* made suggested changes.

538e847c

Update Model Card for Mamba-2 (#37951) · 4f7b0ff8

Parag Ekbote authored 4 weeks ago


* update model page.

* update model page.

* Update docs/source/en/model_doc/mamba2.md

Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>

* update the model page.

* update.

* Apply suggestions from code review

Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>

* Apply the suggestions from code review

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* add an quantization example and update the toctree.

* Apply suggestions from code review

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

* remove the additional comma

---------

Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

4f7b0ff8

[mllama] Allow `pixel_values` with `inputs_embeds` (#38334) · 9c505768
Cory Cornelius authored 4 weeks ago
```
* Allow pixel_values and inputs_embeds at the same time

* remove unnecessary overwritten tests
```
9c505768
[tests] remove overload for deleted test (`test_offloaded_cache_implementation`) (#37896) · 0f5a8243
Joao Gante authored 4 weeks ago
```
* remove overload for deleted tests

* make fixup
```
0f5a8243
[cleanup] delete deprecated kwargs in qwen2_audio 🧹 (#38404) · f85fd904
Joao Gante authored 4 weeks ago
```
delete deprecated
```
f85fd904

[CSM] update model id (#38211) · b9f8f863

eustlb authored 4 weeks ago

* update model id

* codec_model eval

* add processor img

* use ungated repo for processor tests

b9f8f863

Add report_repo_id to mi300 workflow (#38401) · 07dd6b24
ivarflakstad authored 4 weeks ago

07dd6b24
[CSM] infer codec model with no_grad + audio eos label (#38215) · 3142bd85
eustlb authored 4 weeks ago
```
* infer codec model with no_grad

* codec_model eval

* training labels: add audio eos token
```
3142bd85

Fix Qwen2.5-VL Video Processor (#38366) · 10ae443e

Ye Liu authored 4 weeks ago

* Update processing_qwen2_5_vl.py

* Update processing_qwen2_5_vl.py

* Update modular_qwen2_5_vl.py

* Fix CI

* Update modular_qwen2_5_vl.py

* Update processing_qwen2_5_vl.py

* Update video_processing_utils.py

10ae443e

[chat] use the checkpoint's `generation_config.json` as base parameterization (#38330) · 80902ae9
Joao Gante authored 4 weeks ago
```
* use model gen config

* unwanted diff
```
80902ae9
Fix convert to original state dict for VLMs (#38385) · 008e0d87
hoshi-hiyouga authored 4 weeks ago
```
* fix convert to original state dict

* fix

* lint

* Update modeling_utils.py
```
008e0d87
[chat] improvements for thinking models and reduce default verbosity (#38322) · c7694831
Joao Gante authored 4 weeks ago
```
misc improvements
```
c7694831
guard size mismatch check to only quantized models (#38397) · 55f23333
Marc Sun authored 4 weeks ago
```
fix
```
55f23333
[aya vision] fix processor for vLLM (#38371) · 1a5be2f5
Raushan Turganbay authored 4 weeks ago
```
accidentally merged two PRs in one (；－＿－)
```
1a5be2f5
[video utils] group and reorder by number of frames (#38374) · 19fdb75c
Raushan Turganbay authored 4 weeks ago
```
fix
```
19fdb75c
[paligemma] fix processor with suffix (#38365) · b0735dc0
Raushan Turganbay authored 4 weeks ago
```
fix pg processor
```
b0735dc0

[transformers x vLLM] standardize processors (#37915) · 9e1017b4

Raushan Turganbay authored 4 weeks ago


* standardize

* fix tests

* batch update some processors, not final yet

* oke, now I tested that everything indeed runs. Still needs prettification

* emu3

* fixup

* gemma3 but it doesn't generate anything

* fuyu

* update

* why?

* Update src/transformers/models/aya_vision/processing_aya_vision.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

* address comments

* bc

* why do we need to guard import this every time?

* i hate guarded imports

* i am blind

---------

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

9e1017b4

Fix image token mask in Gemma3 (#38295) · b5ececb9
Cyril Vallez authored 4 weeks ago
```
fix mask
```
b5ececb9

26 May, 2025 16 commits

Add AMD MI300 CI caller leveraging self-hosted runner scale set workflow in hf-workflows (#38132) · c4e71e8f
Jitesh Gupta authored 4 weeks ago

c4e71e8f

Stop autoconverting custom code checkpoints (#37751) · 706b0092

Matt authored 4 weeks ago

* Stop autoconverting custom code checkpoints

* make fixup

* Better auto class detection

* Match the kwarg ordering

706b0092

update gemma tests (#38384) · 07848a84

Yih-Dar authored 4 weeks ago


* update

* update

* update

* update

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

07848a84

[cli] cli usable without torch (#38386) · cd0f3ce7
Joao Gante authored 4 weeks ago
```
cli without torch
```
cd0f3ce7

🚨

Fix custom code saving (#37716) · ba6d7222

Matt authored 4 weeks ago

* Firstly: Better detection of when we're a custom class

* Trigger tests

* Let's break everything

* make fixup

* fix mistaken line doubling

* Let's try to get rid of it from config classes at least

* Let's try to get rid of it from config classes at least

* Fixup image processor

* no more circular import

* Let's go back to setting `_auto_class` again

* Let's go back to setting `_auto_class` again

* stash commit

* Revert the irrelevant changes until we figure out AutoConfig

* Change tests since we're breaking expectations

* make fixup

* do the same for all custom classes

* Cleanup for feature extractor tests

* Cleanup tokenization tests too

* typo

* Fix tokenizer tests

* make fixup

* fix image processor test

* make fixup

* Remove warning from register_for_auto_class

* Stop adding model info to auto map entirely

* Remove todo

* Remove the other todo

* Let's start slapping _auto_class on models why not

* Let's start slapping _auto_class on models why not

* Make sure the tests know what's up

* Make sure the tests know what's up

* Completely remove add_model_info_to_*

* Start adding _auto_class to models

* Start adding _auto_class to models

* Add a flaky decorator

* Add a flaky decorator and import

* stash commit

* More message cleanup

* make fixup

* fix indent

* Fix trust_remote_code prompts

* make fixup

* correct indentation

* Reincorporate changes into dynamic_module_utils

* Update call to trust_remote_code

* make fixup

* Fix video processors too

* Fix video processors too

* Remove is_flaky additions

* make fixup

ba6d7222

Stop TF weight rename reDOS (#38325) · 701caef7

Matt authored 4 weeks ago

* let's try a non-regex solution

* make fixup

* Slight adjustment

* Let's just use the original code with a check

* slight tweak to conditional

* slight tweak to conditional

701caef7

fix typo: `tokenizer` -> `tokenize` (#38357) · 0a4e8e28
Judd authored 4 weeks ago

0a4e8e28
fix typos (#38336) · 63964b7c
Ragnar authored 4 weeks ago
```
* Update video_processor.md

* Update deepseek_v3.md
```
63964b7c
Better check in `initialize_weights` (#38382) · 8b03c8ea
Cyril Vallez authored 4 weeks ago
```
* Update modeling_utils.py

* CIs

* CIs
```
8b03c8ea

Use one `utils/notification_service.py` (#38379) · eb74cf97

Yih-Dar authored 4 weeks ago


* step 1

* step 2

* step 3

* step 4

* step 5

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

eb74cf97

for now disable compile (#38383) · 98328fd9
Arthur authored 4 weeks ago

98328fd9

Improved cache docs (#38060) · 78079abe

Manuel de Prada Corral authored 4 weeks ago


* improved cache docs

Co-authored-by: Steven Liu <59462357+stevhliu@users.noreply.github.com>

78079abe

[Falcon H1] Fix slow path forward pass (#38320) · 7a9b071b

Dhia Eddine Rhaiem authored 4 weeks ago


* Create push-important-models.yml

* feat: add falcon-h1

* fixup

* address comment

* fix

* fix copies

* fix copies

* fix

* fix

* fix

* fix

* fix copies

* fix

* fix copies

* fix test import to at least trigget the cis

* yups

* update

* fix make fix copies

* fix inits?

* fix style

* skip annoying test

* add integration test for Falcon H1

* fix copies

* fix

* fix typo

* make style

* fix slow path generations

* clean debug traces

* debug

* remove debug traces final confirmation

* clean debug traces final

* fix format and lineup

* make style

* debug

* Update src/transformers/models/falcon_h1/modular_falcon_h1.py

Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>

* adress comments

* fix fix-copies

* fix integration test

* Merge pull request #7 from ydshieh/fix-slow-path

update

* another update (#8)

* update

* update

---------

Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

---------

Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Younes Belkada <younesbelkada@gmail.com>
Co-authored-by: younesbelkada <younes.belkada@tii.ae>
Co-authored-by: Arthur Zucker <arthur.zucker@gmail.com>
Co-authored-by: Anton Vlasjuk <73884904+vasqu@users.noreply.github.com>
Co-authored-by: Yih-Dar <2521628+ydshieh@users.noreply.github.com>
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>

7a9b071b

Protect `get_default_device` for torch<2.3 (#38376) · b5b76b55
Cyril Vallez authored 4 weeks ago
```
* Update modeling_utils.py

* CIs
```
b5b76b55

Fix incorrect batching audio index calculation for Phi-4-Multimodal (#38103) · bff32678

Isotr0py authored 4 weeks ago


* fix

Signed-off-by: Isotr0py <2037008807@qq.com>

* add tests

Signed-off-by: Isotr0py <2037008807@qq.com>

* code format

Signed-off-by: Isotr0py <2037008807@qq.com>

* Update src/transformers/models/phi4_multimodal/feature_extraction_phi4_multimodal.py

Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

---------

Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>

bff32678

Fix all import errors based on older torch versions (#38370) · 9f0402bc
Cyril Vallez authored 4 weeks ago
```
* Update masking_utils.py

* fix

* fix

* fix

* Update masking_utils.py

* Update executorch.py

* fix
```
9f0402bc