llm-foundry
29b41ba9 - Use `sync_module_states: True` when using HSDP (#830)

Commit

2 years ago

Use `sync_module_states: True` when using HSDP (#830)

References

#830 - Use `sync_module_states: True` when using HSDP

Author

abhi-mosaic

abhi-mosaic

Parents

Loading