transformers
976189a6 - Fix initialization for missing parameters in `from_pretrained` under ZeRO-3 (#28245)

Commit
2 years ago
Fix initialization for missing parameters in `from_pretrained` under ZeRO-3 (#28245) * Fix initialization for missing parameters in `from_pretrained` under ZeRO-3 * Test initialization for missing parameters under ZeRO-3 * Add more tests * Only enable deepspeed context for per-module level parameters * Enable deepspeed context only once * Move class definition inside test case body
Author
Parents
Loading