pytorch-lightning
FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric
#20440
Merged
Overview
Commits
13
Changes
View On GitHub

FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric #20440

lantiga merged 13 commits into master from luca/fp8-fsdp2-compile-examples
lantiga
lantiga Minimal transformer examples
c6695f8a
github-actions github-actions added fabric
github-actions github-actions added pl
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
fcf115a4
lantiga lantiga assigned lantiga lantiga 1 year ago
lantiga lantiga added distributed
lantiga Add tests for compile after fsdp2/tp
8be123a3
lantiga Add README's
27c36d9b
lantiga Add docs
ca3c4cf1
lantiga lantiga marked this pull request as ready for review 1 year ago
lantiga lantiga requested a review from Borda Borda 1 year ago
lantiga lantiga requested a review from tchaton tchaton 1 year ago
lantiga lantiga requested a review from justusschock justusschock 1 year ago
lantiga lantiga requested a review from ethanwharris ethanwharris 1 year ago
github-actions
lantiga Rename folder, add cross-reference
55a6fde8
lantiga lantiga force pushed from 1cf53e6b to 55a6fde8 1 year ago
github-actions github-actions added docs
lantiga Fix link
06c6af62
lantiga lantiga changed the title Minimal FP8 + FSDP2 + compile examples for PyTorch Lightning and Fabric FP8 + FSDP2 + torch.compile examples for PyTorch Lightning and Fabric 1 year ago
codecov
lantiga Newline after code-block directive
acb31252
lantiga Update section name
1646eca0
lantiga Fix reference
3d6cea6a
lantiga Half standalone tests batch size
4eaac170
tchaton
tchaton approved these changes on 2024-11-26
lantiga
lantiga
Borda
Borda approved these changes on 2024-11-26
mergify mergify added ready
lantiga
lantiga Fix integration tests
a8310cf6
pre-commit-ci[bot] [pre-commit.ci] auto fixes from pre-commit.com hooks
71a4b97b
lantiga
lantiga lantiga merged 87565cbc into master 1 year ago
lantiga lantiga deleted the luca/fp8-fsdp2-compile-examples branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
ready docs distributed fabric pl
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum