transformers
7b00e3ba - fix: preserve rotary_pct across save/load cycle in GPTNeoX configs (#44985)

Commit
9 days ago
fix: preserve rotary_pct across save/load cycle in GPTNeoX configs (#44985) * fix: preserve rotary_pct across save/load cycle in GPTNeoX configs Use setdefault instead of unconditional assignment for partial_rotary_factor in GPTNeoXConfig and GPTNeoXJapaneseConfig, so the value saved in rope_parameters is not overwritten with the default on reload. * refactor: simplify partial_rotary_factor to use setdefault per review Replace the 4-line if/else block with a single setdefault call, matching the pattern already used for rope_theta on the line above. As suggested by @zucchini-nlp in PR review.
Parents
Loading