accelerate
5adf855f - [FSDP2] Auto-exclude non-floating frozen Params4bit from fully_shard to prevent QLoRA crash (#3987)

Commit
122 days ago
[FSDP2] Auto-exclude non-floating frozen Params4bit from fully_shard to prevent QLoRA crash (#3987) * fix: auto-exclude non-floating frozen Params4bit * add test * add warning and remove logger patch in test file * fix not to append all param in params4bit and remove tests
Author
Parents
Loading