transformers
[CB] Varlen path: copy only the used prefix of the index storages, build indices in numpy
#48565
Open

[CB] Varlen path: copy only the used prefix of the index storages, build indices in numpy #48565

qgallouedec wants to merge 10 commits into main from cb-varlen-index-prefix
qgallouedec
qgallouedec CB: transfer only the used prefix of the varlen index storages
c6f71091
qgallouedec CB: vectorize the sliding-window allocator's read and write indices
ea0d34df
qgallouedec CB: build the varlen index tensors through numpy
1f4238ea
qgallouedec Sort imports and format
d6771f4b
qgallouedec Import numpy in input_outputs
cffbc256
qgallouedec Merge branch 'main' into cb-varlen-index-prefix
5fed5a10
qgallouedec qgallouedec requested a review from remi-or remi-or 12 days ago
qgallouedec qgallouedec requested a review from ArthurZucker ArthurZucker 12 days ago
HuggingFaceDocBuilderDev
qgallouedec Merge branch 'main' into cb-varlen-index-prefix
16e71c46
qgallouedec Merge branch 'main' into cb-varlen-index-prefix
abbcf587
qgallouedec Merge branch 'main' into cb-varlen-index-prefix
7de252a8
qgallouedec Merge branch 'main' into cb-varlen-index-prefix
ad11c2eb
github-actions

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone