llm-foundry
fixed rmsnorm bug. Changed division to multiply since using torch.rsqrt
#372

Merged

fixed rmsnorm bug. Changed division to multiply since using torch.rsqrt #372

vchiley merged 2 commits into mosaicml:main from vancoykendall:van/rmsnorm-fix

fixed rmsnorm bug. Changed division to multiply since using torch.rsqrt

df0667a9

vchiley approved these changes on 2023-06-26

Merge branch 'main' into van/rmsnorm-fix

4d6d7365

vchiley merged 625f263f into main 2 years ago

vancoykendall deleted the van/rmsnorm-fix branch 2 years ago

Reviewers

vchiley

Assignees

No one assigned

Labels

None yet

Milestone

No milestone