text-generation-inference
feat: support force downcast after FastRMSNorm multiply for Gemma
#1658

Merged

feat: support force downcast after FastRMSNorm multiply for Gemma #1658

Narsil merged 3 commits into main from fix-gemma-bugs

feat: support force downcast after FastRMSNorm multiply

b307fce6

Narsil commented on 2024-03-20

feat: prefer gemma specific rms

5b076dfc

fix: simplify syntax

704d4ddf

Narsil approved these changes on 2024-03-21

Narsil merged 6f15ac60 into main 1 year ago

Narsil deleted the fix-gemma-bugs branch 1 year ago

Reviewers

Narsil

Assignees

No one assigned

Labels

None yet

Milestone

No milestone