PR #2766 Create tensor parallelism blog/tutorial

Create tensor parallelism blog/tutorial #2766

jeffra merged 12 commits into master from mosm/tp2_tutorial

Copy outdated tutorial from old branch

95cfbea9

Update tutorial

c98e6a1d

Add large token size results and pre-commit

4ff6a012

Remove outdated list link. Reword intro

7042c294

Add lists of known supported and unsupported models

4bc6f1a2

Update tutorial with inference refactor API

913b1622

awan-10 commented on 2023-02-15

jeffra commented on 2023-02-16

Update paragrash explaining old method. Add test_performance flag exp…

bba5bf8a

mrwyattii commented on 2023-02-16

Update docs/_tutorials/automatic-tensor-parallelism.md

63dbc496

molly-smith marked this pull request as ready for review 3 years ago

molly-smith requested a review from

RezaYazdaniAminabadi 3 years ago

molly-smith requested a review from

lekurile 3 years ago

lekurile approved these changes on 2023-02-16

Update t5 examples with runnable code

c95a6fd8

Tables of Contents, python headers, inference suite readme

74187223

update header hierarchy to group example script sections

81f3f39f

Merge branch 'master' into mosm/tp2_tutorial

5a1d0767

jeffra approved these changes on 2023-02-21

jeffra merged 3253e7db into master 3 years ago

jeffra deleted the mosm/tp2_tutorial branch 3 years ago

Reviewers

jeffra

lekurile

mrwyattii

awan-10

RezaYazdaniAminabadi

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Create tensor parallelism blog/tutorial #2766 Merged

Create tensor parallelism blog/tutorial #2766

DeepSpeed
Create tensor parallelism blog/tutorial
#2766

Merged