PR #9725 [V1] Prototype Fully Async Detokenizer

[V1] Prototype Fully Async Detokenizer #9725

robertgshaw2-redhat wants to merge 12 commits into main from rs-prototype

prototype

8f8662ef

revert spurious 2.5 changes

01c4ca84

stash

1ad8a481

cleanup

f9084f61

add MQLLMEnginev1

72bccd97

work with MQLLMEngine

a6cab52a

format

885ed16f

cleanup formatting

3ed66cfd

revert exmple change

8ae8ce9c

update comment

5c725152

formatting

f9b33faa

robertgshaw2-redhat changed the title ~~[V1] Prototyping fully async detokenization~~ [V1] Prototyping Async Detokenizer 1 year ago

robertgshaw2-redhat changed the title ~~[V1] Prototyping Async Detokenizer~~ [V1] Prototype More Decoupled Detokenizer 1 year ago

robertgshaw2-redhat changed the title ~~[V1] Prototype More Decoupled Detokenizer~~ [V1] Prototype Fully Async Detokenizer 1 year ago

robertgshaw2-redhat commented on 2024-10-27

updated

82539b9f

robertgshaw2-redhat closed this 1 year ago

robertgshaw2-redhat deleted the rs-prototype branch 1 year ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone