llama.cpp
Fix and restrict NVFP4 edge-cases in llama-graph
#24331
Merged

Fix and restrict NVFP4 edge-cases in llama-graph #24331

ORippler
ORippler Move post-GEMM MUL required for dequant b4 lora and bias add
21ab2d77
ORippler Restrict build_ffn for NVFP4 to supported combinations
592c2c3c
ORippler ORippler requested a review from CISC CISC 70 days ago
CISC
CISC
CISC approved these changes on 2026-06-09
ORippler
ORippler ORippler requested a review from ggerganov ggerganov 68 days ago
ORippler ORippler requested a review from ngxson ngxson 68 days ago
ORippler
ggerganov ggerganov assigned ggerganov ggerganov 64 days ago
ggerganov
ggerganov approved these changes on 2026-06-16
ORippler ORippler merged 02810c7a into master 63 days ago
ORippler ORippler deleted the osimons/nvfp4_scale_b4_lora_b4_bias branch 63 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
Labels
Milestone