transformers
[distributed] experts offload: read misses with safetensors' Reader
#51066
Open
Go
Login via GitHub
Home
FAQ
Install
Login
via GitHub
Overview
Commits
2
Changes
View On
GitHub
[distributed] experts offload: read misses with safetensors' Reader
#51066
McPatate
wants to merge 2 commits into
stream-experts
from
stream-experts-safetensors-reader
experts offload: read misses with safetensors' Reader
47da1e0e
experts offload: one Reader call per batch of rows
1c7bf405
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub