huggingface/transformers

Pull Requests Commits

Decouple tp_plan and ep_plan for expert parallelism.

3outeille committed 10 minutes ago

98f6bbd8

style: ruff import block formatting in distributed config

3outeille committed 34 minutes ago

a0032b08

Update src/transformers/distributed/mixin.py

3outeille committed 34 minutes ago

21f3c816

3outeille committed 34 minutes ago

56390cf5

3outeille committed 34 minutes ago

cbfef371

3outeille committed 34 minutes ago

05feb04c

Add dense and expert device mesh views with a MeshManager

3outeille committed 34 minutes ago

6ba84d02

3outeille committed 35 minutes ago

8e427d79

Enable expert parallelism in the Mega MoE example

3outeille committed 35 minutes ago

1bfa20fa

Use ep_size in the Kimi K2.5 expert parallel example

3outeille committed 35 minutes ago

c425ef9f

3outeille committed 35 minutes ago

8f461d84

3outeille committed 35 minutes ago

23c5c753

3outeille committed 35 minutes ago

08b5ae18

3outeille committed 35 minutes ago

ade25951

Add dense and expert device mesh views with a MeshManager

3outeille committed 35 minutes ago

c667cbd5

docs: fix dead doc links in i18n READMEs and the xlnet docstring (#48905)

simpleqt committed 1 hour ago

Verified 3713bd83

Align special tokens on the text config (#48847)

qgallouedec committed 1 hour ago

Verified ea31b0c6

DOC: Improve documentation for remap_legacy_layer_types function (#48651)

mathewOracle committed 1 hour ago

Verified 266cc923

docs: fix docstring parameters that do not match signatures (#48904)

simpleqt committed 1 hour ago

Verified c9ad4a71

Fix tests due to dropping attn mask (#48903)

SunMarc committed 2 hours ago

Verified b856a67b

Improve lazy import error messages (#48602)

karatarassul4-max committed 2 hours ago

Verified 7301fbc6

fix(vibevoice-asr): use integer ceiling division for audio token count (#48864)

ege-arhan committed 3 hours ago

Verified 719d8090

Modular conversion small fix (#48934)

zucchini-nlp committed 4 hours ago

Verified 95ad2ed0

Fix possessive typo in Whisper long-form warning (#48877)

erikdw committed 4 hours ago

Verified bdb4cc00

Standardise Aria's MoE onto the experts interface (#48907)

hmellor committed 5 hours ago

Verified fd204af8

Update arXiv citation in NeoMME model doc (#48926)

tonywu71 committed 8 hours ago

Verified 18556136

Fix compile cache tests (#48923)

Cyrilvallez committed 9 hours ago

Verified 9b819e72

Size the device_map buffer from the largest leaf module (#47211)

dhruv7477 committed 12 hours ago

Verified 4618eba1

Fix T5 tied weights order for lm_head (#48238)

vaibhavmashal committed 12 hours ago

Verified 483b8806

Clean up some MoE models' integration tests (#48833)

ydshieh committed 1 day ago

Verified 6c6bac29

Older