SD3.5 Large support #1719
kohya-ss
merged
31 commits into
sd3
from
sd3_5_support
refactor SD3 CLIP to transformers etc.
623017f7
reduce memory usage in sample image generation
e3c43bda
support SD3.5L, fix final saving
0286114b
support block swap with fused_optimizer_pass
f8c5146d
Merge branch 'sd3' into sd3_5_support
f52fb66e
support SD3 LoRA
d2c549d7
add latent scaling/shifting
0031d916
fix errors in SD3 LoRA training with Text Encoders close #1724
56bf7611
fix sample image generation without seed failed close #1726
014064fd
Merge branch 'sd3' into sd3_5_support
150579db
Merge branch 'sd3' into sd3_5_support
b649bbf2
Add dropout rate arguments for CLIP-L, CLIP-G, and T5, fix Text Encod…
db2b4d41
Fix SD3 LoRA training to work (WIP)
a1255d63
prevent unintended cast for disk cached TE outputs
d4f78495
Fix to work dropout_rate for TEs
1065dd1b
Fix sample image gen to work with block swap
af8e2160
Fix error on saving T5XXL
75554867
Fix split_qkv
0af4edd8
Support Lora
d4e19fbd
Merge branch 'sd3_5_support' of https://github.com/kohya-ss/sd-script…
80bb3f4e
Fix additional LoRA to work
ce5b5325
Merge branch 'sd3' into sd3_5_support
c9a14171
Fix emb_dim to work.
b502f584
support SD3.5M
bdddc20d
Merge branch 'sd3_5_support' of https://github.com/kohya-ss/sd-script…
8c3c825b
Fix to use SDPA instead of xformers
70a179e4
Support SD3.5M multi resolutional training
1434d850
Update SD3 training
9e23368e
Fix crashing if image is too tall or wide.
830df4ab
Fix memory leak in latent caching. bmp failed to cache
9aa6f52a
remove duplicate resolution for scaled pos embed
82daa98f
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub