PR #1779 Improve block swap speed and apply to LoRA

Improve block swap speed and apply to LoRA #1779

kohya-ss merged 12 commits into sd3 from faster-block-swap

faster block swap

81c0c965

remove unused weight swapping functions from utils.py

aab943ce

Merge branch 'sd3' into faster-block-swap

b8d3feca

fix illeagal block is swapped #1764

186aa5b9

Refactor block swapping to utilize custom offloading utilities

02bd76e6

Merge branch 'sd3' into faster-block-swap

7feaae5f

feat: implement block swapping for FLUX.1 LoRA (WIP)

cde90b89

Merge branch 'sd3' into faster-block-swap

17cf249d

feat: add block swap for FLUX.1/SD3 LoRA training

2cb7a6db

update grad hook creation to fix TE lr in sd3 fine tuning

2bb0f547

refactor: remove unused prepare_split_model method from FluxNetworkTr…

5c5b544b

docs: update README

fd2d879a

kohya-ss merged 0047bb1f into sd3 1 year ago

kohya-ss deleted the faster-block-swap branch 1 year ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone