Adaptive dynamic number of speculative tokens #34156
ArthurZucker
merged
32 commits into
huggingface:main
from
jmamou:adaptive-SL
initial commit
4899591f
Merge branch 'main' into adaptive-SL
3468e4cd
update strategy
83f6219e
add tradeoff FPR TPR with cost
c12b8d1c
all probs
0703ec2f
Merge branch 'main' into adaptive-SL
f0494c99
fix
25d76fd2
fix
be87f257
fix style
31412c64
Update src/transformers/generation/configuration_utils.py
53d5d0a0
import guard
1082497b
Merge remote-tracking branch 'origin/main' into adaptive-SL
471e7f5d
fix style
23bf1706
Merge branch 'main' into adaptive-SL
01809b72
add is_sklearn_available condition
a5d2c308
Merge remote-tracking branch 'origin/main' into adaptive-SL
2106fd3e
keyboardAnt
commented
on 2024-11-17
vectorizing to flatten the for-loop
a5db3ef8
Merge branch 'main' into adaptive-SL
ead02fcc
fix style
88da9f0b
Merge branch 'main' into adaptive-SL
bdd5afb0
Merge branch 'main' into adaptive-SL
67ff646a
disable adaptation for UAG
cc423bae
update doc
11bbe3a0
ArthurZucker
commented
on 2024-11-22
ArthurZucker
commented
on 2024-11-22
Merge branch 'main' into adaptive-SL
daa265eb
Merge branch 'main' into adaptive-SL
b1ee28f8
Merge branch 'main' into adaptive-SL
18a1e01c
Merge branch 'main' into adaptive-SL
9f7fdbdc
add TestAssistedCandidateGeneratorUpdateStrategy
8bba3f3e
Merge branch 'main' into adaptive-SL
eae619b5
fix style
2de64841
protect import
d0294c46
fix style
417ac460
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub