llama.cpp
convert : write tensors in parallel
#12837
Open

convert : write tensors in parallel #12837

compilade wants to merge 4 commits into master from compilade/parallel-convert
compilade
compilade convert : write tensors in parallel
06e1d311
compilade compilade added performance
compilade compilade added python
compilade compilade requested a review from ngxson ngxson 213 days ago
ngxson
CISC
CISC commented on 2025-04-08
compilade
compilade
compilade gguf-py : add more clarifying comments for multi-thread writes
d8bab9ef
ngxson
compilade
ngxson
ngxson approved these changes on 2025-04-09
ngxson
compilade
compilade
ngxson
compilade
compilade Merge branch 'master' into compilade/parallel-convert
d7db1593
compilade gguf-py : use ThreadPoolExecutor when writing tensors
3fe362fe
ngxson
compilade
ngxson
compilade
ngxson
ngxson
Nexesenex
compilade

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone