diffusers
[`Research Project`] Add AnyText: Multilingual Visual Text Generation And Editing
#8998
Merged
Overview
Commits
130
Changes
View On GitHub

[`Research Project`] Add AnyText: Multilingual Visual Text Generation And Editing #8998

a-r-r-o-w merged 130 commits into huggingface:main from tolgacangoz:Add-AnyText
tolgacangoz
tolgacangoz Add initial template
6e8088f6
tolgacangoz Second template
98c2d6ed
tolgacangoz feat: Add TextEmbeddingModule to AnyTextPipeline
867bbbfd
tolgacangoz feat: Add AuxiliaryLatentModule template to AnyTextPipeline
8818372d
tolgacangoz Merge branch 'main' into Add-AnyText
37c46d8b
tolgacangoz Add bert tokenizer from the anytext repo for now
64c63ebd
tolgacangoz feat: Update AnyTextPipeline's modify_prompt method
92f8b792
tolgacangoz Fill in the `forward` pass of `AuxiliaryLatentModule`
e9c688c0
tolgacangoz `make style && make quality`
42a41d01
tolgacangoz `chore: Update bert_tokenizer.py with a TODO comment suggesting the u…
9d50f808
tolgacangoz Merge branch 'main' into Add-AnyText
22aa69a3
tolgacangoz Update error handling to raise and logging
5e1e515a
tolgacangoz Add `create_glyph_lines` function into `TextEmbeddingModule`
2d10f0c2
tolgacangoz make style
bc197a93
tolgacangoz Up
e52d8cce
tolgacangoz Up
8c69d83c
tolgacangoz Up
4a413aab
tolgacangoz Up
571608be
tolgacangoz Merge branch 'main' into Add-AnyText
2b1b50db
tolgacangoz Remove several comments
a7d025f7
tolgacangoz refactor: Remove ControlNetConditioningEmbedding and update code acco…
d2c5a65e
tolgacangoz Merge branch 'main' into Add-AnyText
c1f538c0
tolgacangoz Up
2607b6b8
tolgacangoz Up
a9fe4a05
tolgacangoz up
567f553c
tolgacangoz refactor: Update AnyTextPipeline to include new optional parameters
a9991d05
tolgacangoz Merge branch 'main' into Add-AnyText
e69c51e3
tolgacangoz up
91252e03
tolgacangoz Merge branch 'main' into Add-AnyText
e54f876f
tolgacangoz feat: Add OCR model and its components
b9164e3e
tolgacangoz chore: Update `TextEmbeddingModule` to include OCR model components a…
cd4c9c22
tolgacangoz chore: Update `AuxiliaryLatentModule` to include VAE model and its de…
0918cbd8
tolgacangoz `make style`
37ae99fa
tolgacangoz Merge branch 'main' into Add-AnyText
15fd4df8
tolgacangoz Merge branch 'main' into Add-AnyText
2e40224a
tolgacangoz refactor: Update `AnyTextPipeline`'s docstring
b475a3b6
tolgacangoz Update `AuxiliaryLatentModule` to include info dictionary so that tex…
ea957f08
tolgacangoz simplify
cc0c6e59
tolgacangoz `make style`
52fb0b4d
tolgacangoz Merge branch 'main' into Add-AnyText
187473d8
tolgacangoz Converting `TextEmbeddingModule` to ordinary `encode_prompt()` function
9dd4ee90
tolgacangoz Simplify for now
7dbd4bc4
tolgacangoz `make style`
f4224234
tolgacangoz Merge branch 'main' into Add-AnyText
62bb2a05
tolgacangoz Up
84660095
tolgacangoz feat: Add scripts to convert AnyText controlnet to diffusers
2b4be7a7
tolgacangoz Merge branch 'main' into Add-AnyText
d4718fd9
tolgacangoz `make style`
1cdbb55a
tolgacangoz Fix: Move glyph rendering to `TextEmbeddingModule` from `AuxiliaryLat…
da67ff7b
tolgacangoz make style
af30f0f6
tolgacangoz Up
a8dbbe20
tolgacangoz Merge branch 'main' of github.com:huggingface/diffusers into Add-AnyText
12fca1ce
tolgacangoz Merge branch 'main' into Add-AnyText
bbfe8f2f
tolgacangoz Simplify
936c2ff6
tolgacangoz Merge branch 'main' into Add-AnyText
73d81444
tolgacangoz Up
cffa0361
tolgacangoz feat: Add safetensors module for loading model file
8b43bc34
tolgacangoz
tolgacangoz Fix device issues
f60a72bf
tolgacangoz Up
be4a319b
tolgacangoz Merge branch 'main' into Add-AnyText
18d3f608
tolgacangoz Up
f7131713
tolgacangoz merge
da9adbb6
tolgacangoz Merge branch 'main' into Add-AnyText
fdf0275a
tolgacangoz refactor: Simplify
f347ff2e
tolgacangoz refactor: Simplify code for loading models and handling data types
d52e9737
tolgacangoz `make style`
a3b493f8
tolgacangoz Merge branch 'main' into Add-AnyText
020074ab
tolgacangoz refactor: Update to() method in FrozenCLIPEmbedderT3 and TextEmbeddin…
4267c848
tolgacangoz refactor: Update dtype in embedding_manager.py to match proj.weight
ab512260
tolgacangoz Merge branch 'main' of github.com:huggingface/diffusers
c961a96c
tolgacangoz Merge branch 'main' into Add-AnyText
3873d02e
tolgacangoz Merge branch 'main' of github.com:huggingface/diffusers
5041d400
tolgacangoz Up
1521e8f5
tolgacangoz Merge branch 'main' into Add-AnyText
1aa17bbb
tolgacangoz Merge branch 'main' into Add-AnyText
c13c61d3
a-r-r-o-w
tolgacangoz
tolgacangoz Merge branch 'main' into Add-AnyText
1d18f1d7
tolgacangoz Merge branch 'main' into Add-AnyText
44a3a70a
tolgacangoz Add attribution and adaptation information to pipeline_anytext.py
56992d11
tolgacangoz Update usage example
7ad68658
tolgacangoz Will refactor `controlnet_cond_embedding` initialization
a5edca5d
tolgacangoz Merge branch 'main' into Add-AnyText
48e88eb9
tolgacangoz Add `AnyTextControlNetConditioningEmbedding` template
2f42e402
tolgacangoz Refactor organization
670fef5d
tolgacangoz style
930c37ad
tolgacangoz Merge branch 'main' into Add-AnyText
923da7b9
tolgacangoz style
21c0c35d
tolgacangoz Move custom blocks from `AuxiliaryLatentModule` to `AnyTextControlNet…
c4db96a3
tolgacangoz Merge branch 'main' into Add-AnyText
e2e7160c
tolgacangoz Merge branch 'main' into Add-AnyText
4335ebda
tolgacangoz Follow one-file policy
6bd0b4cd
tolgacangoz style
b3f98a77
HuggingFaceDocBuilderDev
github-actions
github-actions github-actions added stale
tolgacangoz Merge branch 'main' into Add-AnyText
cccf0f48
tolgacangoz Merge branch 'main' into Add-AnyText
b5856a67
tolgacangoz Merge branch 'main' into Add-AnyText
b04d015e
github-actions github-actions removed stale
tolgacangoz Merge branch 'main' into Add-AnyText
67f8839c
tolgacangoz Merge branch 'main' into Add-AnyText
d75508eb
tolgacangoz [Docs] Update README and pipeline_anytext.py to use AnyTextControlNet…
75a0f1f6
tolgacangoz [Docs] Update import statement for AnyTextControlNetModel in pipeline…
d3dcf57f
tolgacangoz [Fix] Update import path for ControlNetModel, ControlNetOutput in any…
963fac0b
tolgacangoz Merge branch 'main' of github.com:huggingface/diffusers into Add-AnyText
0c941437
tolgacangoz Refactor AnyTextControlNet to use configurable conditioning embedding…
2b6f08ba
tolgacangoz Merge branch 'main' into Add-AnyText
971d6ad8
tolgacangoz Complete control net conditioning embedding in AnyTextControlNetModel
9c43a652
github-actions
github-actions github-actions added stale
tolgacangoz Merge branch 'main' into Add-AnyText
d46ac3e8
asomoza
tolgacangoz
github-actions github-actions removed stale
tolgacangoz Merge branch 'main' into Add-AnyText
2ffb80b2
tolgacangoz up
b8ca0d67
tolgacangoz [FIX] Ensure embeddings use correct device in AnyTextControlNetModel
9657980a
tolgacangoz up
25ea8be7
tolgacangoz up
2be7bca1
tolgacangoz style
0fc4aabe
tolgacangoz [UPDATE] Revise README and example code for AnyTextPipeline integrati…
5345702d
tolgacangoz [UPDATE] Update example code in anytext.py to use correct font file a…
5b73a1d9
tolgacangoz down
7f87755d
tolgacangoz [UPDATE] Refactor BasicTokenizer usage to a new Checker class for tex…
61693a58
tolgacangoz update pillow
3b2435fd
tolgacangoz [UPDATE] Remove commented-out code and unnecessary docstring in anyte…
3ea49c15
tolgacangoz [REMOVE] Delete frozen_clip_embedder_t3.py as it is in the anytext.py…
299a646d
tolgacangoz [UPDATE] Replace edict with dict for configuration in anytext.py and …
0d44b5ba
tolgacangoz 🆙
13b7ecf2
tolgacangoz style
d5a6e5f0
tolgacangoz [UPDATE] Revise README.md for clarity, remove unused imports in anyte…
09fdd222
tolgacangoz Merge branch 'main' into Add-AnyText
f8f5edd0
tolgacangoz style
9495ddb9
tolgacangoz tolgacangoz marked this pull request as ready for review 1 year ago
tolgacangoz Merge branch 'main' into Add-AnyText
13ab2485
tolgacangoz
asomoza
a-r-r-o-w
a-r-r-o-w approved these changes on 2025-03-01
a-r-r-o-w a-r-r-o-w requested a review from yiyixuxu yiyixuxu 1 year ago
tolgacangoz Update examples/research_projects/anytext/README.md
f4abaf21
tolgacangoz Remove commented-out image preparation code in AnyTextPipeline
8d313bce
tolgacangoz Remove unnecessary blank line in README.md
d02615f1
tolgacangoz tolgacangoz requested a review from a-r-r-o-w a-r-r-o-w 1 year ago
tolgacangoz Merge branch 'main' into Add-AnyText
52aa9241
tolgacangoz Merge branch 'main' into Add-AnyText
78447b2f
tolgacangoz Merge branch 'main' into Add-AnyText
3e3f9724
a-r-r-o-w
a-r-r-o-w approved these changes on 2025-03-10
a-r-r-o-w a-r-r-o-w merged b88fef47 into main 1 year ago
tolgacangoz
tolgacangoz tolgacangoz deleted the Add-AnyText branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum