Megatron-DeepSpeed
e06841cf - corby's numerically mmore stable self attn version

Commit

4 years ago

corby's numerically mmore stable self attn version

References

self_attention_stable_corby

Author

stas00

stas00

Parents

Loading