huggingface/transformers

Pull Requests Commits

Fix: correct sharding dims

S1ro1 committed 1 year ago

d4b01f2f

WIP: boiler plate for dp+tp

S1ro1 committed 1 year ago

f13e867c

Merge branch 'main' into tp-size

S1ro1 committed 1 year ago

Verified c0737368

handle torch version edge cases (#37399)

winglian committed 1 year ago

Verified 9cda4265

the fix that did not get in (#37370)

ArthurZucker committed 1 year ago

Verified e032d12e

Attention Quantization with FBGemm & TP (#37384)

MekkCyber committed 1 year ago

Verified f834ca2c

Fix some failing AWQ tests (#37383)

DerekLiu35 committed 1 year ago

Verified c5c648dd

Merge branch 'main' into tp-size

SunMarc committed 1 year ago

Verified d77505c0

Apply torchfix to replace deprecated functions: `_pytree._register_pytree_node` and `torch.cpu.amp.autocast` (#37372)

bzhong-solink committed 1 year ago

Verified 71b35387

Fix warning message for PEFT models in text-generation pipeline #36783 (#36887)

falconlee236 committed 1 year ago

Verified ad340908

Add "selecting a quantization method" doc (#37159)

DerekLiu35 committed 1 year ago

Verified 2527f71a

fix: nit in docs

kmehant committed 1 year ago

a65130c6

fix: review cmt - error when tp_plan not set for tp_size

kmehant committed 1 year ago

bb2950d1

feat: custom tp_size, new transformers tp interface

kmehant committed 1 year ago

1059fffb

update deepspeed docker (#37371)

SunMarc committed 1 year ago

Verified 7ae0be72

Add glm4 (#37388)

ArthurZucker committed 1 year ago

Verified e3eda6d1

fix: llama4 conversion script no_rope_layers (#37359)

jmkuebler committed 1 year ago

Verified 1e6ff5fd

Update composition flag usage (#36263)

zucchini-nlp committed 1 year ago

Verified 6f4058ae

Preserve requires_grad in pre quantized model (#37354)

jerryzh168 committed 1 year ago

Verified 08e3217b

:rotating_light: :rotating_light: Setup -> setupclass conversion (#37282)

Rocketknight1 committed 1 year ago

Verified 4d0de5f7

fix(qwen): fix shape error when using tp (#36947)

KimmiShi committed 1 year ago

Verified c15a7adb

prune LM Head for USD (#36695)

jmamou committed 1 year ago

Verified 121f91d3

[core] remove `GenerationMixin` inheritance by default in `PreTrainedModel` (#37173)

gante committed 1 year ago

Verified 4321b064

Skip non-selected experts for mixtral and qwen2_moe (#32429)

Coco58323 committed 1 year ago

Verified aab08783

[llama 4] dynamic rope decorator (#37365)

gante committed 1 year ago

Verified 35f0f5b5

Set vision config to None for Gemma 1B conversion (#37366)

RyanMullins committed 1 year ago

Verified 530322cc

fix deepspeed job (#37284)

ydshieh committed 1 year ago

Verified 8064cd9b

A bit of cleaning 🧹🧹 (#37215)

Cyrilvallez committed 1 year ago

Verified cdfb018d

Use Python 3.9 syntax in tests (#37343)

cyyever committed 1 year ago

Verified 1e6b546e

convert float for yarn related arguments in rope_scaling (#37139)

bzantium committed 1 year ago

Verified 0fc683d1

Older