DeepSpeed
57b10d54 - Throw error when parameter is modified in GatheredParameters (#7832)

Commit
12 days ago
Throw error when parameter is modified in GatheredParameters (#7832) #7817 added a test to verify that we throw an error when parameters are modified in `GatheredParameters` and `modifier_rank` is None. However, the PR just checks devices and doesn't detect modifications on parameters. This causes an [error](https://github.com/deepspeedai/DeepSpeed/actions/runs/21653729382/job/62424014222) in our full test run. This PR adds the detection of parameter modifications to properly throw an error. --------- Signed-off-by: Masahiro Tanaka <mtanaka@anyscale.com> Co-authored-by: Olatunji Ruwase <tunji.ruwase@snowflake.com>
Author
Parents
Loading