Megatron-DeepSpeed
48902f15 - Corby's numerically more stable self attn version (#118)

Commit

4 years ago

Corby's numerically more stable self attn version (#118) * corby's numerically more stable self attn version * no alibi in this branch yet

References

Author

stas00

Parents