Support `auto_doctring` in Processors #42101
yonigozlan
merged
87 commits into
huggingface:main
from
yonigozlan:support-auto_doctring-in-processor
remove attributes and add all missing sub processors to their auto cl…
f48a47bd
remove all mentions of .attributes
d5d5c58d
cleanup
dd505b53
fix processor tests
6a1448f8
fix modular
a2929000
remove last attributes
63a255d7
fixup
ef737597
Merge remote-tracking branch 'upstream/main' into remove-attributes-f…
b5e8b2ec
fixes after merge
f14ff3c9
fix wrong tokenizer in auto florence2
0306430d
fix missing audio_processor + nits
01cb8158
Override __init__ in NewProcessor and change hf-internal-testing-repo…
49ec9068
Merge remote-tracking branch 'upstream/main' into remove-attributes-f…
7dd56828
fix auto tokenizer test
946cc5c4
add init to markup_lm
b0cb3e07
update CustomProcessor in custom_processing
3b9e8464
remove print
53de7a4c
Merge branch 'main' into remove-attributes-from-processors
93d2c4d6
Merge remote-tracking branch 'upstream/main' into remove-attributes-f…
feeec281
nit
4a6b0806
Merge branch 'remove-attributes-from-processors' of https://github.co…
02402a07
fix test modeling owlv2
757e1f1f
fix test_processing_layoutxlm
bf763b29
Fix owlv2, wav2vec2, markuplm, voxtral issues
0799a0ae
Merge remote-tracking branch 'upstream/main' into remove-attributes-f…
bf1a4b64
add support for loading and saving multiple tokenizer natively
e3f130da
remove exclude_attributes from save_pretrained
cc45a7ed
Run slow v2 (#41914)
6b9e7c96
Fix `detectron2` installation in docker files (#41975)
0ccb0e3c
Fix `autoawq[kernels]` installation in quantization docker file (#41978)
1eeece53
add support for saving encoder only so any parakeet model can be load…
e4d0a09b
Use indices as position_ids in modernebert (#41789)
09702b28
test tensor parallel: make tests for dense model more robust (#41968)
688a79c2
fix: dict[RopeParameters] to dict[str, RopeParameters] (#41963)
e44838b7
docs: add continuous batching page (#41847)
98287d9b
Fix `torchcodec` version in quantization docker file (#41988)
85b0bd9f
[kernels] Add Tests & CI for kernels (#41765)
e798fe4c
Move the Mi355 to regular docker (#41989)
c7a631bf
More data in benchmarking (#41848)
55938f48
fix (CI): Refactor SSH runners (#41991)
76fbe5a4
fix 3 failed test cases for video_llama_3 model on Intel XPU (#41931)
3b87190d
Integrate colqwen2.5 using colqwen2 modelling code (#40600)
c33037bb
Fixed wrong padding value in OWLv2 (#41938)
de108405
Fix `run slow v2`: empty report when there is only one model (#42002)
f639ad6a
[kernels] change import time in KernelConfig (#42004)
135543ae
DOC Fix typo in argument name: pseudoquant (#41994)
adf67773
Fix `torch+deepspeed` docker file (#41985)
f37903bc
Correct syntax error in trainer.md (#42001)
6a5d5ce4
Reduce the number of benchmark in the CI (#42008)
1f8ae37f
Fix continuous batching tests (#42012)
9488b268
add back `logging_dir` (#42013)
0a703ee2
Fix issue with from pretrained and kwargs in image processors (#41997)
2f2a82ce
Fix default image_rows and image_cols initialization in Idefics3 and …
0143c60a
Add GLPNImageProcessorFast (#41725)
af380ffb
add fuyu fast image processors (#41817)
98c0528b
[kernels] Fix XPU layernorm kernel (#41583)
8ec84367
[v5] Deprecate Text2Text and related pipelines (#41996)
a63b6da1
[FPQuant] MXFP8 and MXFP4 backwards support (#41897)
a3f3937b
Merge remote-tracking branch 'upstream/main' into support-auto_doctri…
5b552a9b
add working auto_docstring for processors
09d55274
add auto_docstring to processors first part
b542e95f
add auto_docstring to processors part 2
552509ce
modifs after review
89796459
Merge remote-tracking branch 'upstream/main' into remove-attributes-f…
6cc30f90
Merge branch 'remove-attributes-from-processors' into support-auto_do…
30f1b922
Merge remote-tracking branch 'upstream/main' into support-auto_doctri…
bd5aae26
Merge remote-tracking branch 'upstream/main' into support-auto_doctri…
0af5a60f
fully working auto_docstring and check_docstring with placeholder doc…
4f8a7ba4
Working check_docstrings for Typed dicts
b9136ef9
Add recurring processor args to auto_docstring and add support for re…
68f178b4
replace placeholders with real docstrings
1ce14e9a
Merge remote-tracking branch 'upstream/main' into support-auto_doctri…
0ee2c3f0
fix copies
22b29b8a
fixup
8d5ffa81
remove unwanted changes
ab1f03b5
yonigozlan
changed the title
fix unprotected imports
525804c1
Fix unprotected imports
852b458c
fix unprotected imports
03d1cd30
Add __call__ to all docs of processors
22721cd7
Cyrilvallez
approved these changes
on 2026-01-07
Merge remote-tracking branch 'upstream/main' into support-auto_doctri…
b1705997
nits docs
b73220de
Merge branch 'main' into support-auto_doctring-in-processor
dcea25a5
Merge branch 'main' into support-auto_doctring-in-processor
80b849f8
Merge remote-tracking branch 'upstream/main' into support-auto_doctri…
edae1363
Merge branch 'support-auto_doctring-in-processor' of https://github.c…
14a50708
add flaky test
b3bf0e34
Merge remote-tracking branch 'upstream/main' into support-auto_doctri…
d639cd94
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub