vllm
Fix target matching for fused layers with compressed-tensors
#12617

Merged

Commits

Properly match fused layers

eldarkurtic committed 1 year ago
fix line length

eldarkurtic committed 1 year ago
fix style

eldarkurtic committed 1 year ago
make sure all fused layers have the same quant

eldarkurtic committed 1 year ago

Loading