concurrency without model cloning #573
initial test version
a2379a97
more tests and code cleanup
6798a660
dtrawins
marked this pull request as ready for review 1 year ago
Merge remote-tracking branch 'origin/main' into no-clone-concurrency
02a129ae
fix python3.8 execution
be1a32db
test fixes for latest transformers and review fixes
fe71151a
review updates
66676614
merge with main
4bb1370e
style fixes
ae47a4ec
Merge remote-tracking branch 'origin/main' into no-clone-concurrency
9fdd8334
concurrency without overriding past_key_values with infer context
bd106a71
echarlaix
approved these changes
on 2024-04-18
fix passing beam_idx content for stateless models
93e40eea
merge from main
bb40376a
cleanup and style
e5b60753
style
f7653b25
merge from main
8de1511e
change dict to Dict from typing
0ecaa0fc
fix type declaration
aec45a9d
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub