transformers
[distributed] experts offload: read misses with safetensors' Reader
#51066
Open

[distributed] experts offload: read misses with safetensors' Reader #51066

McPatate wants to merge 2 commits into stream-experts from stream-experts-safetensors-reader
McPatate
McPatate experts offload: read misses with safetensors' Reader
47da1e0e
McPatate experts offload: one Reader call per batch of rows
1c7bf405

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone