llama.cpp
Force NVFP4 W4A8 path for NVFP4_W4A16 layers on Blackwell, where NVFP4 normally uses the native W4A4 path.
#24364
Open
Open
Force NVFP4 W4A8 path for NVFP4_W4A16 layers on Blackwell, where NVFP4 normally uses the native W4A4 path. #24364
ynankani
wants to merge
2 commits into
ggml-org:master
from
ynankani:ynankani/Force_W4A16_NVFP4_to_W4A8
Login to write a write a comment.
Login via GitHub