PR #2473 Tied embeddings in MLP speculator.

Tied embeddings in MLP speculator. #2473

Narsil merged 3 commits into main from upgrade_mlp_speculator2

OlivierDehaene commented on 2024-08-29

Tied embeddings in MLP speculator.

62a83431

Fixing the scale_weight when users decide to not use the speculation as

09a1de5c

Adding scaling support + optimize some ops.

9f036684

Narsil force pushed from 8cef03f6 to 9f036684 2 years ago

OlivierDehaene approved these changes on 2024-08-29

Narsil merged d9fbbaaf into main 2 years ago

Narsil deleted the upgrade_mlp_speculator2 branch 2 years ago

Reviewers

OlivierDehaene

Assignees

No one assigned

Labels

None yet

Milestone

No milestone