llm-foundry
625f263f - fixed rmsnorm bug. Changed division to multiply since using torch.rsqrt (#372)

Commit
2 years ago
fixed rmsnorm bug. Changed division to multiply since using torch.rsqrt (#372) Co-authored-by: vcoykendall <vcoykendall@dgx09.phx15.castle.fm> Co-authored-by: Vitaliy Chiley <6439018+vchiley@users.noreply.github.com>
Author
Parents
Loading