transformers
Add pipeline parallel plan to `PretrainedConfig` and `PreTrainedModel`
#36091
Merged

Add pipeline parallel plan to `PretrainedConfig` and `PreTrainedModel` #36091

ArthurZucker merged 25 commits into huggingface:main from hmellor:add-pp-plan
hmellor
hmellor Add `base_model_pp_plan` to `PretrainedConfig`
64f1fd67
hmellor Add `_pp_plan` to `PreTrainedModel`
040ba146
hmellor Add both to Llama for testing
ac56826c
hmellor Fix type error
fee056f4
nmntz
nmntz commented on 2025-02-07
nmntz nmntz assigned nmntz nmntz 1 year ago
HuggingFaceDocBuilderDev
hmellor Update to suggested schema
826cd178
hmellor `_pp_plan` keys are not patterns
cfee6801
nmntz nmntz unassigned nmntz nmntz 1 year ago
ArthurZucker
ArthurZucker commented on 2025-02-07
hmellor Simplify schema
7e03c0db
hmellor
hmellor Fix typing error
b9ee76ff
hmellor Update input name for Llama
f5ed1518
hmellor Add pp plan to Aria
cb60de85
hmellor Add pp plan to Bamba
9a079032
hmellor Add pp plan to Cohere 1 & 2
57a2aa57
hmellor Add pp plan to diffllama and emu3
2703a9e8
hmellor Add pp plan to Gemma 1 & 2
19f53461
hmellor Add pp plan to GLM and GPT NeoX
5de4151d
hmellor Add pp plan to Granite and Helium
3a490d86
hmellor Add pp plan to Mistral and Mixtral
0c2c8df9
hmellor Add pp plan to OLMo 1 & 2
c8960621
hmellor Add pp plan to Phi and Phi 3
c01266db
hmellor Add pp plan for Qwen 2, 2 MoE, 2 VL and 2.5 VL
81c11859
hmellor Add pp plan for Starcoder 2
95cec4b2
hmellor Add enum for accessing inputs and outputs
387e3a85
hmellor Merge branch 'main' into add-pp-plan
dd1a2d51
hmellor hmellor marked this pull request as ready for review 1 year ago
hmellor hmellor requested a review from ArthurZucker ArthurZucker 1 year ago
hmellor hmellor requested a review from nmntz nmntz 1 year ago
ArthurZucker
ArthurZucker approved these changes on 2025-02-10
nmntz
nmntz approved these changes on 2025-02-10
hmellor Update type hints to use tuples
dca584d0
hmellor Change outer list to tuple
02129121
hmellor
ArthurZucker
ArthurZucker approved these changes on 2025-02-11
ArthurZucker ArthurZucker merged f5fff672 into main 1 year ago
hmellor hmellor deleted the add-pp-plan branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone