transformers
[cb] sample per-request settings without sorting the vocabulary
#51043
Open

[cb] sample per-request settings without sorting the vocabulary #51043

SunMarc wants to merge 3 commits into main from cb-fused-sampling
SunMarc
SunMarc Sample per-request settings in continuous batching without sorting th…
61ae2b08
SunMarc SunMarc changed the title Continuous batching: sample per-request settings without sorting the vocabulary [cb] sample per-request settings without sorting the vocabulary 1 day ago
SunMarc Type the sampler's fused processors as Any: they are of three classes
375ad5fc
SunMarc SunMarc requested a review from remi-or remi-or 1 day ago
HuggingFaceDocBuilderDev
SunMarc Sample one setting for the whole batch without sorting the vocabulary…
287f8e58
remi-or

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone