DeepSpeed
76a40757 - UlyssesSP: TiledMLP doc - recomputes forward twice (#7664)

Commit

70 days ago

UlyssesSP: TiledMLP doc - recomputes forward twice (#7664) Make it very clear that `TiledMLP`'s memory saving has a cost of recomputing forward.

References

Author

stas00

Parents