Commits huggingface/transformers

backend tokenizer support

itazap committed 8 minutes ago

ab759172

Fix XVector outputs of the wav2vec2 family when the TDNN layers are offloaded (#50646)

ydshieh committed 1 day ago

Verified fde3a351

[`Offloading`] Fix tests for some models (#50631)

vasqu committed 1 day ago

Verified 06edaf11

[`FA`] Fix FA tests for unique models (#50632)

vasqu committed 1 day ago

Verified 1ee78b6e

🚨 Slim down `[audio]` to torchaudio + soundfile + soxr (drop librosa and phonemizer) (#50610)

eustlb committed 1 day ago

Verified 880561aa

[`GptOss`] Fix the kernels autodispatch test (#50630)

vasqu committed 1 day ago

Verified f61791ca

Expert-parallel implementations for `ep_dispatch_experts`: all-reduce at inference, all-to-all in training (#49429)

IlyasMoutawwakil committed 1 day ago

Verified b7394bc7

Exporters: run exported models on their backend's runtime (`ModelRunner`) (#50032)

IlyasMoutawwakil committed 1 day ago

Verified 57583c28

Exporters: ONNX Runtime fusions at export time (`OnnxConfig(ort_fusions=...)`) (#50309)

IlyasMoutawwakil committed 1 day ago

Verified 5b99c07c

⚠️ i [`distributed`] Checkpoint the layer's `forward`, not `__call__`, so FSDP2 hooks stay outside the checkpoint (#50490)

3outeille committed 1 day ago

Verified c527bbf6

🚨 Deprecate Wav2Vec2ProcessorWithLM and pyctcdecode/kenlm LM decoding (#50408)

eustlb committed 1 day ago

Verified f210a32f

Fix Ministral3 and Mistral4 ignoring packed sequences under FlashAttention (#50450)

EvanZhuang committed 1 day ago

Verified a065282c

🚨 Exporters: `ExportedModel`, Hub save/load, one backend registry (#50029)

IlyasMoutawwakil committed 1 day ago

Verified 28ec08c4

fix(pipelines): respect problem_type in image and video classification pipelines (#50582)

surendra902 committed 2 days ago

Verified a72a1c38

Support Enum in get_json_schema, raise on custom classes (#50583)

Rocketknight1 committed 2 days ago

Verified 715b48b1

Raise ValueError for empty conversation with continue_final_message in render_jinja_template (#50604)

Mengxi-Xu committed 2 days ago

Verified ebfd5e76

QA: move to transformers-mlinter 0.1.6 (#50071)

tarekziade committed 2 days ago

Verified 9082094f

fix some error in quantization xpu ci test (#49910)

sywangyi committed 2 days ago

Verified e4e4e988

Fix Step3.7 vision RoPE spatial W/H axis order (#50547)

caohch-1 committed 2 days ago

Verified 335dd96b

Raise ValueError for out-of-range float images in convert_to_rgb (#50487)

n24q02m committed 2 days ago

Verified 34ac6a57

Fix RecurrentGemma padded generation by declaring its `layer_types` (#50577)

ydshieh committed 2 days ago

Verified 07cc8e8c

fixed typo in docs - changed "a encoder-decoder" to "an encoder-decoder" (#50591)

Peter-Bergman committed 2 days ago

Verified e5ce72af

Revert "Add `transcription` input arg to `apply_transcription_request ` (#49869)" (#50587)

ebezzam committed 2 days ago

Verified f41b35a2

Bump doc-builder (#50550)

stevhliu committed 2 days ago

Verified 2ac1093a

[docs] Output capturing (#50529)

stevhliu committed 2 days ago

Verified 7ebb1328

Tests: skip audio model tests when torchaudio or librosa is missing (#50423)

IlyasMoutawwakil committed 2 days ago

Verified 2a540d5c

CI: install OpenVINO and NNCF in the daily GPU image (#50422)

IlyasMoutawwakil committed 2 days ago

Verified 9ae35c18

Clarify that causal LM labels are shifted internally (#44642)

joshuaswanson committed 2 days ago

Verified 6488cabb

Avoid device -> host syncs in load_balancing_loss_func (#50463)

ntenenz committed 2 days ago

Verified fee0f2b9

Fix grouped RMSNorm in Mamba2's non-fused path (#49744)

taking-lying-flat committed 2 days ago

Verified c4f1520d