llama.cpp
Multi-threaded quantization
#1075
Merged

Multi-threaded quantization #1075

ggerganov merged 6 commits into master from multi-thread-quantize
ikawrakow
Multi-threading quantization.
d2f92662
Multi-threading for quantize-stats
ce05fc0a
ikawrakow ikawrakow requested a review from sw sw 2 years ago
ikawrakow ikawrakow requested a review from unbounded unbounded 2 years ago
DannyDaemonic
ggerganov
ggerganov approved these changes on 2023-04-20
ggerganov ggerganov added performance
Reviewer comments
b65e559a
Avoiding compiler confusion
7fae1c4e
Still fighting with lambda captures in MSVC
0ae02ebb
prusnak
ggerganov Merge branch 'master' into multi-thread-quantize
b3545d9a
ggerganov ggerganov merged 38de86a7 into master 2 years ago
ggerganov ggerganov deleted the multi-thread-quantize branch 2 years ago
ggerganov ggerganov assigned ikawrakow ikawrakow 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone