transformers
[`Llama2`] replace `self.pretraining_tp` with `self.config.pretraining_tp`
#24906

Merged

[`Llama2`] replace `self.pretraining_tp` with `self.config.pretraining_tp` #24906

younesbelkada merged 3 commits into huggingface:main from younesbelkada:temp-llama

add possibility to disable TP

b058189c

younesbelkada requested a review from

sgugger 2 years ago

younesbelkada requested a review from

ArthurZucker 2 years ago

fixup

5ed93cbe

sgugger commented on 2023-07-19

adapt from offline discussions

0ea52e9f

younesbelkada changed the title ~~[`core`] / [`Llama2`] Add possibility to disable Tensor Parallelism~~ [`core`] / [`Llama2`] replace `self.pretraining_tp` with `self.config.pretraining_tp` 2 years ago

younesbelkada changed the title ~~[`core`] / [`Llama2`] replace `self.pretraining_tp` with `self.config.pretraining_tp`~~ [`Llama2`] replace `self.pretraining_tp` with `self.config.pretraining_tp` 2 years ago

sgugger approved these changes on 2023-07-19

ArthurZucker approved these changes on 2023-07-19

younesbelkada merged ee4250a3 into main 2 years ago

younesbelkada deleted the temp-llama branch 2 years ago

Reviewers

ArthurZucker

sgugger

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers [`Llama2`] replace `self.pretraining_tp` with `self.config.pretraining_tp` #24906 Merged

[`Llama2`] replace `self.pretraining_tp` with `self.config.pretraining_tp` #24906

transformers
[`Llama2`] replace `self.pretraining_tp` with `self.config.pretraining_tp`
#24906

Merged