PR #34240 Self-speculation (Layer-Skip Llama)

Self-speculation (Layer-Skip Llama) #34240

gante merged 16 commits into main from layer-skip

😅

47a0963a

early exit (#34244)

42f0df69

pcuenca commented on 2024-10-21

a few fixes

317edb66

ArthurZucker changed the title ~~Draft~~ Draft layer skip addition 1 year ago

mostafaelhoushi commented on 2024-10-22

no shared cache

c7671974

mostafaelhoushi commented on 2024-11-15

Apply suggestions from code review

2bf9c785

docs

c267831e

Merge branch 'main' into layer-skip

3d24097f

make fix-copies

6d6ee243

cohere fix

2ab17262

[test all]

ec9dfa2a

gante marked this pull request as ready for review 1 year ago

gante commented on 2024-11-18

[test all] consistent model code copies

7a8cda0f

gante approved these changes on 2024-11-18

[test all] make fix-copies :D

8dfa29aa

pcuenca approved these changes on 2024-11-18

mostafaelhoushi approved these changes on 2024-11-18

Apply suggestions from code review

cc383678

gante changed the title ~~Draft layer skip addition~~ Self-speculation (Layer-Skip Llama) 1 year ago

gante commented on 2024-11-19

Update src/transformers/generation/candidate_generator.py

a480556a

Update src/transformers/generation/configuration_utils.py

7850f025

ArthurZucker commented on 2024-11-19

[test all] don't use a stand-alone attribute; fix test

a1aa8c9a

gante merged 54739a32 into main 1 year ago

gante deleted the layer-skip branch 1 year ago

Reviewers

pcuenca

gante

mostafaelhoushi

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers Self-speculation (Layer-Skip Llama) #34240 Merged

Self-speculation (Layer-Skip Llama) #34240

transformers
Self-speculation (Layer-Skip Llama)
#34240

Merged