optimum-intel
concurrency without model cloning
#573
Open

concurrency without model cloning #573

dtrawins wants to merge 17 commits into huggingface:main from dtrawins:no-clone-concurrency
dtrawins
dtrawins initial test version
a2379a97
dtrawins more tests and code cleanup
6798a660
dtrawins dtrawins marked this pull request as ready for review 1 year ago
dtrawins Merge remote-tracking branch 'origin/main' into no-clone-concurrency
02a129ae
dtrawins fix python3.8 execution
be1a32db
dtrawins
HuggingFaceDocBuilderDev
slyalin
slyalin commented on 2024-03-04
dtrawins test fixes for latest transformers and review fixes
fe71151a
helena-intel helena-intel requested a review from eaidova eaidova 1 year ago
helena-intel helena-intel requested a review from echarlaix echarlaix 1 year ago
echarlaix
echarlaix commented on 2024-03-07
echarlaix
echarlaix commented on 2024-03-07
dtrawins review updates
66676614
dtrawins merge with main
4bb1370e
dtrawins style fixes
ae47a4ec
dtrawins Merge remote-tracking branch 'origin/main' into no-clone-concurrency
9fdd8334
echarlaix
echarlaix commented on 2024-03-28
dtrawins concurrency without overriding past_key_values with infer context
bd106a71
echarlaix
echarlaix approved these changes on 2024-04-18
dtrawins fix passing beam_idx content for stateless models
93e40eea
dtrawins merge from main
bb40376a
dtrawins cleanup and style
e5b60753
dtrawins style
f7653b25
dtrawins merge from main
8de1511e
dtrawins change dict to Dict from typing
0ecaa0fc
dtrawins fix type declaration
aec45a9d
echarlaix

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone