transformers
Exporters: run exported models (`ExportedModel`)
#50032
Open

Exporters: run exported models (`ExportedModel`) #50032

IlyasMoutawwakil wants to merge 18 commits into exporters-artifacts from exporters-forward-runtime
IlyasMoutawwakil
IlyasMoutawwakil IlyasMoutawwakil requested a review from echarlaix echarlaix 7 days ago
HuggingFaceDocBuilderDev
IlyasMoutawwakil IlyasMoutawwakil marked this pull request as ready for review 7 days ago
echarlaix
echarlaix approved these changes on 2026-10-28
ArthurZucker
ArthurZucker approved these changes on 2026-11-02
IlyasMoutawwakil Exporters: run single-graph exports (ExportedModel, AutoExportedModel)
54eb6f1d
IlyasMoutawwakil Exporters: sort the runtimes import, return only tensors from the Exe…
942a0a73
IlyasMoutawwakil Exporters: rebuild the model's outputs from the traced specs, drop Au…
7de7cb11
IlyasMoutawwakil IlyasMoutawwakil changed the title Exporters: run exported models (`ExportedModel`, `AutoExportedModel`) Exporters: run exported models (`ExportedModel`) 1 day ago
IlyasMoutawwakil IlyasMoutawwakil force pushed from 75f27de6 to 7de7cb11 1 day ago
IlyasMoutawwakil Exporters: register the cache classes a saved export's specs name bef…
4f164d4e
IlyasMoutawwakil Exporters: keep ONNX Runtime CUDA inputs and outputs on the GPU (IO b…
c8818751
IlyasMoutawwakil Exporters: run ONNX through IO binding on every device, save a runtim…
fa127e11
IlyasMoutawwakil Exporters: bind only tensor inputs on ONNX, copy OpenVINO outputs once
6b9fba9b
IlyasMoutawwakil Exporters: feed ExecuTorch string constants as None, keep non-string …
69c33a98
IlyasMoutawwakil Exporters: let runtime() pass runner options, ONNX Runtime providers …
b7a1d1b4
IlyasMoutawwakil Exporters: compile OpenVINO in the export's precision on CPU, take co…
c4f40cf5
IlyasMoutawwakil Exporters: choose per call whether a runner shares its inputs and out…
ef7dacfa
IlyasMoutawwakil Exporters: give a torch program the scalars it was traced with, in it…
3b861dd7
IlyasMoutawwakil Exporters: record a None kwarg as a constant too
62191414
IlyasMoutawwakil Exporters: bind ONNX inputs by name, run bf16 convolutions in fp32 on…
6d80fa4b
IlyasMoutawwakil Exporters: feed SDPA's boolean mask to ONNX as an additive one
fc78285f
IlyasMoutawwakil Merge branch 'exporters-artifacts' into exporters-forward-runtime
fc65352a
IlyasMoutawwakil Exporters: read bf16 OpenVINO outputs as bf16
41c68b16
IlyasMoutawwakil Exporters: split the CPU between torch and OpenVINO (`torch_threads`)
90024083

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone