llama.cpp
Check granite hybrid expert count to set type as LLM_TYPE_7B_A1B or LLM_TYPE_1B
#20795
Merged

Check granite hybrid expert count to set type as LLM_TYPE_7B_A1B or LLM_TYPE_1B #20795

victor-villar
victor-villar Check granite hybriid expert count to set type as LLM_TYPE_7B_A1B or …
fc5c28b1
victor-villar victor-villar requested a review from CISC CISC 16 days ago
CISC
CISC commented on 2026-03-20
CISC
CISC approved these changes on 2026-03-20
victor-villar Use feed fwd dim instead of num of experts
6ef919b4
CISC
CISC approved these changes on 2026-03-20
CISC CISC merged 58c81f7e into master 16 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone