diffusers
[cogview4][feat] Support attention mechanism with variable-length support and batch packing
#11349
Merged
Overview
Commits
10
Changes
View On GitHub

[cogview4][feat] Support attention mechanism with variable-length support and batch packing #11349

yiyixuxu merged 10 commits into huggingface:main from OleehyO:main
OleehyO
OleehyO [cogview4] Enhance attention mechanism with variable-length support a…
78b2ad76
OleehyO [cogview4] Fix rope
1fae35e8
OleehyO [cogview4] Fix tensor type after qk norm
255cb5af
OleehyO [cogview4] Add docs for attn processor
1a48dcdd
yiyixuxu
yiyixuxu commented on 2025-04-17
yiyixuxu
a-r-r-o-w
a-r-r-o-w commented on 2025-04-18
OleehyO [chore] Change type hint
f2a6e5ce
OleehyO Rename as CogView4TrainingAttnProcessor
ccf67523
OleehyO
a-r-r-o-w
a-r-r-o-w commented on 2025-04-18
OleehyO [refactor] Back to original signature, using `attention_kwargs` instead
fe0c30b5
OleehyO
a-r-r-o-w
a-r-r-o-w approved these changes on 2025-04-19
a-r-r-o-w a-r-r-o-w requested a review from yiyixuxu yiyixuxu 169 days ago
yiyixuxu
yiyixuxu yiyixuxu added close-to-merge
HuggingFaceDocBuilderDev
yiyixuxu
yiyixuxu commented on 2025-04-21
yiyixuxu Update src/diffusers/models/transformers/transformer_cogview4.py
b70f2080
yiyixuxu
github-actions[bot] Apply style fixes
1f657ac6
github-actions
yiyixuxu Merge branch 'main' into main
ddab0087
yiyixuxu yiyixuxu merged 0434db9a into main 167 days ago
yiyixuxu yiyixuxu removed close-to-merge

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum