text-generation-inference
MLPSpeculator.
#1865
Merged
Overview
Commits
14
Changes
View On GitHub

MLPSpeculator. #1865

Narsil merged 14 commits into main from add_mlp_speculator_test
Narsil
JRosenkranz initial commit of mlp_speculator support (draft)
6e5c19ec
JRosenkranz added a bunch of cleanup based on comments in PR; removed conditional…
453e91f7
Narsil Hardcode a few stuff to make it work.
38d60454
JRosenkranz [REWRITTEN] added a bunch of cleanup based on comments in PR; removed…
9291d428
Narsil Fixed speculator.
1fde6850
Narsil Cleanup.
1a8a18d5
Narsil Removed a bunch of hardcodes.
b8848990
Narsil Rebase after refactor.
71a535e4
Narsil Narsil force pushed from bcb52c7f to 71a535e4 1 year ago
Narsil Narsil changed the title [WIP] MLPSpeculator. MLPSpeculator. 1 year ago
Narsil Missing update after rebase
3397b263
Narsil Remove traces of `use_medusa`.
de11fc06
Narsil Backport changes in medusa.
027e1dab
Narsil Remove old code again.
aceb87cc
Narsil Model_type location.
6009dade
Narsil Reload model_type when speculator is found.
dcb727c2
Narsil
Narsil Narsil merged e3d76564 into main 1 year ago
Narsil Narsil deleted the add_mlp_speculator_test branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum