transformers
[performance_optim] reduce frequency of declaring attention_mask in Ascend NPU flash attention
#38278

Merged

[performance_optim] reduce frequency of declaring attention_mask in Ascend NPU flash attention #38278

ArthurZucker merged 1 commit into huggingface:main from FightingZhen:optim_fa2_perf

FightingZhen force pushed from 5fadf99e to a43c506a 1 year ago

FightingZhen force pushed from a43c506a to 14928611 1 year ago

[performance_optim] reduce frequency of declaring attention_mask in A…

5b31bb0e

FightingZhen force pushed from 14928611 to 5b31bb0e 1 year ago

SunMarc commented on 2025-05-22

SunMarc requested a review from

ArthurZucker 1 year ago

ArthurZucker approved these changes on 2025-05-23

ArthurZucker merged 3c289e21 into main 1 year ago

FightingZhen deleted the optim_fa2_perf branch 351 days ago

Reviewers

ArthurZucker

SunMarc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone