PR #43521 [CB] Minor perf improvements and ty compatibility

[CB] Minor perf improvements and ty compatibility #43521

ArthurZucker merged 21 commits into main from cb-rollout

remi-or requested a review from

ArthurZucker 3 days ago

remi-or assigned

remi-or 3 days ago

Better output

d0eb9084

Better name

e7b7d1b3

Better seqlen_k

b9b2c924

Add a TMP token when scheduling request

7baf12d6

Index selection of logits is in CG

2e9f1ddc

ty 1/n

c8e6f53b

ty part 2/n

04fff205

ty part 3/n

5de438d3

ty part 4/n

1e004c72

ty part 5/n

06baeb63

ty part 6/6

42caf8b7

style

3a062ad0

ty final touches

b8a8462b

No more _

c54bf9c1

Make sure the TMP token never gets outputted

c001ed05

more accurate msg

5487f08d

Fix nit in overall script

43938922

Nit

65b03c7a

style

10dd7f55

remi-or force pushed from 9307c713 to 10dd7f55 3 days ago

ArthurZucker approved these changes on 2026-01-28

Removed useless attribute

9731d3e0

Merge branch 'main' into cb-rollout

0f74b42f

ArthurZucker merged b207f38e into main 2 days ago

ArthurZucker deleted the cb-rollout branch 2 days ago

Reviewers

ArthurZucker

Assignees

remi-or

Labels

None yet

Milestone

No milestone

transformers [CB] Minor perf improvements and ty compatibility #43521 Merged

[CB] Minor perf improvements and ty compatibility #43521

transformers
[CB] Minor perf improvements and ty compatibility
#43521

Merged