support deepspeed
dfe08f39
fix offload_optimizer_device typo
64873c1b
fix vae type error during training sdxl
2824312d
fix all trainer about vae
4295f91d
maybe fix branch to run offloading
3970bf40
apply offloading method runable for all trainer
7d2a9268
fix full_fp16 compatible and train_step
62556619
remove test requirements
2445a5b7
forgot setting mixed_precision for deepspeed. sorry
a98fecae
the reason not working grad accum steps found. it was becasue of my a…
03f0816f
refactored codes, some function moved into train_utils.py
4d5186d1
add some new dataset settings
577e9913
add minimal impl for masked loss
f2c727fc
update readme
17519362
fix typo
4a5546d4
Merge branch 'main' into dev
074d32af
Merge branch 'deep-speed' into deepspeed
eefb3cc1
Merge pull request #1101 from BootsofLagrangian/deepspeed
0e4a5738
make deepspeed_utils
e3ccf8fb
support masked loss in sdxl_train ref #589
a9b64ffb
add doc about Colab/rich issue
14c9372a
Add "encoding='utf-8'"
124ec458
save state on train end
095b8035
Update train_network.py
d282c450
Merge branch 'dev' into masked-loss
74c266a5
Merge branch 'dev' into deep-speed
97524f1b
random ip_noise_gamma strength
948029fe
random noise_offset strength
86399407
use correct settings for parser
53954a1e
Merge branch 'main' into dev
0a8ec522
fix doc
443f0294
Merge branch 'dev' into masked-loss
0ef4fe70
extension of src image could be different than target image
7081a0cf
common masked loss func, apply to all training script
3419c3de
Merge branch 'dev' into deep-speed
86e40fab
Update tag_images_by_wd14_tagger.py
a7dff592
Update requirements.txt
5410a8c7
Update requirements.txt
a71c35cc
fix typo
6c51c971
Merge branch 'main' into dev
e281e867
Merge pull request #1192 from sdbds/main
7da41be2
tagger now stores model under repo_id subdir
80dbbf5e
Merge pull request #1177 from KohakuBlueleaf/random-strength-noise
cf09c6aa
English Translation of config_README-ja.md (#1175)
46331a9e
update readme
5f6196e4
Merge pull request #1167 from Horizon1704/patch-1
119cc99f
update readme
3b0db0f1
Merge pull request #1168 from gesen2egee/save_state_on_train_end
bf6cd4b9
update option help and readme
855add06
Merge branch 'dev' into masked-loss
9b6b39f2
Merge branch 'dev' into deep-speed
fbb98f14
Fix most of ZeRO stage uses optimizer partitioning
d9456020
Merge pull request #1200 from BootsofLagrangian/deep-speed
a35e7bd5
update dataset config doc
d17c0f50
format by black
594c7f70
support multiline captions ref #1155
f4a4c11c
register reg images with correct subset
0c7baea8
disable sample_every_n_xxx if value less than 1 ref #1202
79d1c12a
update readme
691f0432
Merge pull request #1205 from feffy380/patch-1
ad97410b
update readme and typing hint
381c4495
[Experimental] Add cache mechanism for dataset groups to avoid long w…
ae97c8bf
refactor metadata caching for DreamBooth dataset
02534721
Merge branch 'dev' into masked-loss
8d585882
Merge branch 'dev' into deep-speed
993b2ab4
format by black
1648ade6
update PyTorch version and reorganize dependencies
9bbb28c3
fix pytorch version 2.1.1 to 2.1.2
9c4492b5
Merge branch 'dev' into deep-speed
c24422fb
make each script consistent, fix to work w/o DeepSpeed
a2b85316
Merge pull request #1139 from kohya-ss/deep-speed
ea05e3fd
Merge branch 'dev' into masked-loss
ab1e3893
Merge pull request #1207 from kohya-ss/masked-loss
5a2afb35
Merge branch 'dev' into dataset-cache
c86e3560
Merge pull request #1206 from kohya-ss/dataset-cache
78e0a763
update readme
6c08e97e
Add OpenVINO and ROCm ONNX Runtime for WD14
6f7e93d5
Merge pull request #1213 from Disty0/dev
b86af679
Rating support for WD Tagger
dd9763be
fix typo
954731d5
IPEX fix pin_memory
4012fd24
Add --use_rating_tags and --character_tags_first for WD Tagger
bc586ce1
fix to work with num_beams>1 closes #1149
f1f30ab4
Merge branch 'dev' of https://github.com/kohya-ss/sd-scripts into dev
ae3f6257
update readme
434dc408
Merge pull request #1216 from Disty0/dev
6ba84288
update wd14 tagger and doc
cae5aa0a
update tagger doc
f5323e3c
update tagger doc
2c2ca9d7
fix typo
059ee047
add save/load hook to remove U-Net/TEs from state
2258a1b7
fix attention couple+deep shink cause error in some reso
b748b48d
verify command line args if wandb is enabled
cd587ce6
Merge pull request #1240 from kohya-ss/verify-command-line-args
921036dd
update readme
089727b5
Add option to use Scheduled Huber Loss in all training pipelines to i…
90b18795
update readme, add metadata for network module
d30ebb20
update readme
dfa30790
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub