DeepSpeed
f31e5ebe - Expand Ulysses packed and lifecycle coverage

Commit

74 days ago

Expand Ulysses packed and lifecycle coverage

References

#8114 - Add Ulysses SP support for FLA gated-delta context parallelism

Author

sfc-gh-xlian

sfc-gh-xlian

Parents

Loading