[PoC] HF exporters #41992
IlyasMoutawwakil
wants to merge
284 commits into
main
from
hf-exporters
Merge branch 'main' into hf-exporters
8a89c96a
comments
c31154ca
Merge branch 'hf-exporters' of https://github.com/huggingface/transfo…
2b07f0a1
catch cryptic torch assertion error
552fd13b
revert moe changes
d758aa38
patch moes during the export
6e997609
revert unnecessary changes
43114b0c
fix idefics2
3021194a
fix bidirectional attention mask causing the cryptic export error
d7942bb1
fix granitemoehybrid
982aba52
fix bidirectional
9d542e9e
skip qwen 2.5 omni as it has data dependent input processing
293db77a
fix idefic
3d6e4b9b
skip omdet turbo as it uses a custom cache class
6bdbca71
fix a bunch of seq2seqLM models
cdc38dd7
skip some models with highly data-dependent helper methods
f11b7acd
make FalconH1 and qwen3_next exportable
abd43a50
skip emu3
6a2be431
fix some vlms
a7400bfa
fix emot and evolla
d7eae951
fix qwen2 audio and vits
c6942127
create list of unsupported models and raise not implemented
ff975775
fix timesfm and eomt
62ee8ddf
revert ibert
178c7cc3
remove test_torch_exportable flag replaced by the list of unsupported…
a8fe5af3
cleanup
11b28e20
make d-fine exportable
f79a7687
make many more models and vlms exportable
f71019f7
make jamba exportable except its cache class
018879af
make grounding dino exportable
ffb25df5
make more models exportable (led, reformer, videomae, idefics, idefics3)
16738b68
set use_cache to false for models with unsupported cache classes
eaae3637
skip random LSH attention
e435da22
fix docstring
b6cdce88
Merge branch 'main' into hf-exporters
9b45a555
Merge branch 'main' into hf-exporters
bea176df
untangle inputs preparation
82dbfc8e
auto dynamic shapes for int/float/bool
0c749aba
some fixes for dynamic export
a87a39a4
fixes for dynamic export
4066acb8
Merge branch 'main' into hf-exporters
8d3f9565
make the same exporter re-usable and remove PreTrainedModel integration
14cff62f
remove print
c4cc0668
remove warn_on_unsupported_cache_class
321bd1e7
better onnx exporter support and more lenient testing for now
5cf47509
make more models exportable
1d447c9f
skip LSH attention closeness test
c76059a2
list all failing models and omit them for now
7525035b
make seq2seq lm models exportable
366de2a5
fix patch
14cfe34e
fix
425c4554
xenova
commented
on 2025-11-18
xenova
commented
on 2025-11-18
xenova
commented
on 2025-11-18
custom testing for onnx (more lenient)
9a7801b6
separate patch utils file
b31b621b
fix
a05717bb
make siglip2 and lfm2_vl dynamo and onnx exportable
87e56e1f
jackzhxng
commented
on 2025-12-10
justinchuby
commented
on 2025-12-17
xadupre
commented
on 2025-12-18
xadupre
commented
on 2025-12-18
Merge branch 'main' into hf-exporters
1f726f9d
revert modeling changes
48b25be6
revert examples changes
40ae5649
revert a test
0d676623
remove patching
4517aef0
update with latest dynamo compatibility
817c172e
fix idefics tracing
080d7888
make all cache subclasses exportable with a serialization recipe
eeb1aef2
full export support
b43fa07f
fix a lot of onnx non-exportable models
19c9ccda
skip bigbird pegasus
fb5737ee
fix
10e74009
fix bigbird
360ff6ca
updates
7a1d79d7
more onnx fixes
d9edfab1
init executorch
bf77b2aa
executorch test
d93bdf36
executorch cuda recipe
8c87491d
patch rms norm
0954ac6c
first model to pass executorch cuda recipe :)
a7b9be8b
move onnx specific torch patching to onnx
8fb62b1b
executorch patching
05614fb7
fixes
273c1156
json dumpable serialization
bffbd8ee
more onnx compatible exports
4af1159f
reverts
854e28b8
fix
18cd3a9f
simplify
84fc73d1
Merge branch 'main' into hf-exporters
5318ca05
onnxscript
f27212f5
style
1e5e1838
fix
94330d4c
revert unnecesaary
d1528efd
fixes
25cd56ee
dia
6dbdff67
Merge branch 'main' into hf-exporters
a20d7d6b
revert
3b32a738
fix
482ed9ca
better
3bb74af0
style
a42c2b05
fix idefics
5c722167
style
9ddbe863
fix flava
de777f3e
simpler post export fixes
19e3a4b8
fix
5b6a9286
fix
4328e25f
complete rewrite of the onnx exporter in 4 stages - all models are to…
016abf9a
Merge branch 'main' into hf-exporters
e8f8e0a6
revert changes in modeling in favor of patches
13680057
fix
e1a80321
revert and patch masked mean/var
387561b7
more modeling reverts
5a88d63a
revert
47b5e34b
simplify inputs prepartion
90ac060a
stage-specific full export testing (forward, prefill, decode) !
9ea28f57
fix for mllama
6ab1bd5a
docstrings and comments
a16df254
naming
34d07bdb
parametrize tests for auto dynamic export and testing later
1bf9cac2
fix pp doc layout v2
3091fb62
updates
b0a887fc
most of dynamic export passes
6cd3ce72
generic vlm models decomposition
44181082
awesome onnx fix
e7e80a13
final onnx patches and fixes
1155918b
docs
a9fb2605
allow doctest of some stuff (dynamo specifically)
17e894bf
Merge branch 'main' into hf-exporters
656161b7
style
0ad9382e
revert deepseek
eb1712ba
style
67a4d30f
fix style
85de2da8
fix lfm cache
4c949072
revert idefics
47fb0a5a
revert idefics
59044fd8
revert deepseek vl
0886f388
better leaf tensors handling
24d4735f
revert patchtsmixer
4eee8182
fix in onnx exporter order and executorch backend preparation
7c87d353
Merge branch 'main' into hf-exporters
a9bed196
xadupre
commented
on 2026-03-24
xadupre
commented
on 2026-03-24
fix get_rope_index models and chunked vision attn models
b9a547d3
fix annotation
a2d1e8c8
skip video llama 3
b6d68e58
skip ernie vl as well
17156c0f
introduce dynamo patches and make prepare_for_export the least impact…
969dbc30
Merge branch 'main' into hf-exporters
eaabee69
Merge branch 'hf-exporters' of https://github.com/huggingface/transfo…
b21385e8
Merge branch 'main' into hf-exporters
b75ce435
fix after merge
ff50ce8d
ultimatevlm fix (precompute stuff)
1d81213f
fix vlm encoders export through optional precomputed inputs
2fe1d11b
more vlms passing (t5 gemma and paddle ocr)
16cbe4d3
fix qwen omni and paddle ocr export
96e74bc3
fix docs
4a1303e1
fix torch dep
e814592c
annotations
a6bcb66d
revert change
a955ae56
missing licence
3bf6a90a
attempt fix styling
35b4db7f
Merge branch 'main' into hf-exporters
753e70e1
fix torch leak
c508d22f
fix
6a087a51
style
0a196a2d
fix
2b928ae7
style
ee8c7b02
guard
c3a0f24c
same name for torch patches
87b2ca8b
fix detectron failure
f024c9d7
Merge branch 'main' into hf-exporters
adf90da2
fix musicflamingo
16720f9c
fix
4ad2a991
fix
1ac2de80
support and fix gemma4
770cc2e8
update docs
5072edb0
update docs
5ac0267c
make qwen omni audio encoders exportable
27ccc0f7
docs
5364d989
Merge branch 'main' into hf-exporters
0a7baff2
get cu seqlens
9bcca9de
leave paddle ocr
ca6cfdbc
skip paddle ocr
d52bd2e6
fix
efafb3c1
fix layoutlmv2 onnx export
70862cec
fix idefics3 on cpu
0cc6e427
Merge branch 'main' into hf-exporters
ba8f7302
fix falcon_mamba and other idefics
7f9382c9
Merge branch 'main' into hf-exporters
e2e951dc
style and docs
e44c5aec
dict decomposition
1a7e7905
remove deferred
677a90d7
executorch fixes
dab2d144
dynamo doctests passing *-*
6ec03ba5
clean title
5eba3d5e
update
c5c7020d
normalize qwen omni
679eb1b1
only pure functions
ff66d956
patch views for exeuctorch
f0080026
better vision dynamic tensors pre computation
aef0409c
audio functions
2ae78c7d
Merge branch 'main' into hf-exporters
e3e66c6e
fix
d8432a54
fix
234f7eb0
define vision modeling utils
aa220b70
fix docs
a6f9d7b4
style
745e36ac
Merge remote-tracking branch 'origin/main' into hf-exporters
9eba5453
fix repo
41c864e6
update skips
8a5218a3
fixes and skips
f6f47355
fix repo
719157b4
exportable/compilable paddleocr vl
f7e2b069
onnx parity
75977b62
more docs
44c93cf2
style
61140691
move
eb0d6d68
avoid lens
b37d1923
timesfm minicpmv46 canine colqwen2
98445c3c
fix test
32e0ff5c
executorch fixes
e7dd4aa7
executorch fixes
e3fdc32e
more executorch fixes
bc2427d6
Merge branch 'main' into hf-exporters
139d0e4e
Merge branch 'hf-exporters' of https://github.com/huggingface/transfo…
e66362e0
more executorch patches
a9bacd9f
Merge branch 'main' into hf-exporters
0c2ff1d5
Merge branch 'hf-exporters' of https://github.com/huggingface/transfo…
8ddd01d8
fix
26f370d1
Merge branch 'main' into hf-exporters
2be769be
Merge branch 'main' into hf-exporters
c136f1dd
more fixes
25708e07
Update src/transformers/exporters/exporter_dynamo.py
020d874c
stadarize the patching and fixing api more
1e975eb4
fix get_encoder is some models
93bd4167
Merge branch 'main' into hf-exporters
ca64a669
fix style
d63f0257
fix qwen omni get decoder and export
86e3ae9c
fix xlstm export
5619ea62
per model type inputs preparation registery
01cf3f88
standarize torch and library (onnx, executorch) patching and fx progr…
f0256c78
style
8b604d4e
fix gemma4 unified test
104c3796
add export for generation pipeline
4df0ac69
decompose for generation helper function
cca77d2f
style
7537aefd
onnx fixes
3226c294
two pat fix
3bd85f12
vectorized swin attention
14fbffd3
vectorized big bird block sparse attn
4d6c469c
avoid dino timeouts
4e16cf39
big bird and pegasus
07f4b684
fixed unified gemma4
436ed749
sam fixes and simplifications
03a76d37
fix repo
7f6601d3
fix style
0ed56b2a
unify model instance patches with the rest of the patching api
ff542113
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub