diffusers
[Core] support saving and loading of sharded checkpoints
#7830
Merged
Overview
Commits
63
Changes
View On GitHub
Commits
  • feat: support saving a model in sharded checkpoints.
    sayakpaul committed 2 years ago
  • feat: make loading of sharded checkpoints work.
    sayakpaul committed 2 years ago
  • add tests
    sayakpaul committed 2 years ago
  • cleanse the loading logic a bit more.
    sayakpaul committed 2 years ago
  • more resilience while loading from the Hub.
    sayakpaul committed 2 years ago
  • parallelize shard downloads by using snapshot_download()/
    sayakpaul committed 2 years ago
  • default to a shard size.
    sayakpaul committed 2 years ago
  • more fix
    sayakpaul committed 2 years ago
  • Empty-Commit
    sayakpaul committed 2 years ago
  • debug
    sayakpaul committed 2 years ago
  • fix
    sayakpaul committed 2 years ago
  • uality
    sayakpaul committed 2 years ago
  • more debugging
    sayakpaul committed 2 years ago
  • fix more
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • merge main and fix conflicts.
    sayakpaul committed 2 years ago
  • resolve conflicts.
    sayakpaul committed 2 years ago
  • initial comments from Benjamin
    sayakpaul committed 2 years ago
  • move certain methods to loading_utils
    sayakpaul committed 2 years ago
  • add test to check if the correct number of shards are present.
    sayakpaul committed 2 years ago
  • add a test to check if loading of sharded checkpoints from the Hub is okay
    sayakpaul committed 2 years ago
  • clarify the unit when passed as an int.
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • use hf_hub for sharding.
    sayakpaul committed 2 years ago
  • remove unnecessary code
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • remove unnecessary function
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • lucain's comments.
    sayakpaul committed 2 years ago
  • fixes
    sayakpaul committed 2 years ago
  • address high-level comments.
    sayakpaul committed 2 years ago
  • fix test
    sayakpaul committed 2 years ago
  • subfolder shenanigans./
    sayakpaul committed 2 years ago
  • Update src/diffusers/utils/hub_utils.py
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • Apply suggestions from code review
    sayakpaul committed 2 years ago
  • remove _huggingface_hub_version as not needed.
    sayakpaul committed 2 years ago
  • address more feedback.
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • add a test for local_files_only=True/
    sayakpaul committed 2 years ago
  • need hf hub to be at least 0.23.2
    sayakpaul committed 2 years ago
  • style
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • final comment.
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
  • clean up subfolder.
    sayakpaul committed 2 years ago
  • deal with suffixes in code.
    sayakpaul committed 2 years ago
  • _add_variant default.
    sayakpaul committed 2 years ago
  • use weights_name_pattern
    sayakpaul committed 2 years ago
  • remove add_suffix_keyword
    sayakpaul committed 2 years ago
  • clean up downloading of sharded ckpts.
    sayakpaul committed 2 years ago
  • don't return something special when using index.json
    sayakpaul committed 2 years ago
  • fix more
    sayakpaul committed 2 years ago
  • don't use bare except
    sayakpaul committed 2 years ago
  • remove comments and catch the errors better
    sayakpaul committed 2 years ago
  • fix a couple of things when using is_file()
    sayakpaul committed 2 years ago
  • resolve conflicts
    sayakpaul committed 2 years ago
  • empty
    sayakpaul committed 2 years ago
  • Merge branch 'main' into feat-save-sharded-ckpt
    sayakpaul committed 2 years ago
FAQ Terms Privacy Refunds Impressum
Loading