xla
c96c95a4 - [Pallas] Introduce gmm_backward (#7151)

Commit
1 year ago
[Pallas] Introduce gmm_backward (#7151) Summary: This pull request introduces a helper for gmm_backward. I'm still debuting if we need to make gmm as a autograd.function given we will do manual back-propagation in Mixtral. Test Plan: python test/test_gmm.py
Author
Parents
Loading