llama.cpp
TP: fix granularity for Qwen 3.5/3.6 + 3 GPUs
#23843
Merged

TP: fix granularity for Qwen 3.5/3.6 + 3 GPUs #23843

JohannesGaessler
JohannesGaessler JohannesGaessler requested a review from CISC CISC 177 days ago
am17an
am17an approved these changes on 2026-05-29
ggerganov
ggerganov approved these changes on 2026-05-29
CISC
ggerganov
JohannesGaessler JohannesGaessler force pushed 177 days ago
JohannesGaessler TP: fix granularity for Qwen 3.5/3.6 + 3 GPUs
af217000
JohannesGaessler JohannesGaessler force pushed to af217000 176 days ago
JohannesGaessler fix afmoe TP
eb39a518
JohannesGaessler
ggerganov
ggerganov approved these changes on 2026-05-30
ggerganov ggerganov merged 8b0e0db6 into master 176 days ago
jacekpoplawski
JeroenAdam

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone