transformers
45e742d9 - Switch to 4-bit quantization: bfloat16 (716 GiB) OOMs both runners

Commit
11 days ago
Switch to 4-bit quantization: bfloat16 (716 GiB) OOMs both runners Loading GLM-4.5 in bfloat16 with device_map=auto requires ~716 GiB (358B params × 2 bytes) which exceeds the 395 GiB available (373 GiB RAM + 22 GiB GPU), crashing both test runners. 4-bit quantization reduces the footprint to ~179 GiB, which fits comfortably within available memory. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Author
Parents
Loading