diffusers
[benchmarks] overhaul benchmarks
#11565
Merged
Overview
Commits
91
Changes
View On GitHub

[benchmarks] overhaul benchmarks #11565

sayakpaul merged 91 commits into main from benchmarking-overhaul
sayakpaul
sayakpaul start overhauling the benchmarking suite.
24a46cc3
sayakpaul fixes
ab7f381c
sayakpaul fixes
cc0a38a2
sayakpaul checking.
169f831c
sayakpaul checking
ad189839
sayakpaul fixes.
31e34d5e
sayakpaul error handling and logging.
36afdea9
sayakpaul Merge branch 'main' into benchmarking-overhaul
0d3af908
sayakpaul
sayakpaul commented on 2025-05-16
sayakpaul Merge branch 'main' into benchmarking-overhaul
fd85fbc5
sayakpaul Merge branch 'main' into benchmarking-overhaul
a2c03a45
sayakpaul add flops and params.
4d83a478
sayakpaul add more models.
6815cae9
sayakpaul
sayakpaul utility to fire execution of all benchmarking scripts.
5635bf86
sayakpaul utility to push to the hub.
cfbd21e2
sayakpaul push utility improvement
4ccfad02
sayakpaul seems to be working.
dff31446
sayakpaul okay
accd5989
sayakpaul sayakpaul marked this pull request as ready for review 264 days ago
sayakpaul sayakpaul changed the title [WIP][benchmarks] overhaul benchmarks [benchmarks] overhaul benchmarks 264 days ago
sayakpaul
sayakpaul add torchprofile dep.
41f79a00
sayakpaul remove total gpu memory
befdd9ea
sayakpaul fixes
4784b8bc
sayakpaul fix
c19dc5ba
sayakpaul sayakpaul requested a review from DN6 DN6 264 days ago
sayakpaul
sayakpaul need a big gpu
2da4facd
sayakpaul better
7367bb10
sayakpaul what's happening.
1cd472fb
a-r-r-o-w
sayakpaul okay
214795d5
sayakpaul Merge branch 'main' into benchmarking-overhaul
7d4f4591
sayakpaul Merge branch 'main' into benchmarking-overhaul
2d5b3059
sayakpaul
sayakpaul commented on 2025-05-23
sayakpaul Merge branch 'main' into benchmarking-overhaul
dd422448
sayakpaul Merge branch 'main' into benchmarking-overhaul
9d286065
sayakpaul Merge branch 'main' into benchmarking-overhaul
ffed3b35
sayakpaul Merge branch 'main' into benchmarking-overhaul
a28c8813
sayakpaul Merge branch 'main' into benchmarking-overhaul
90b9b421
sayakpaul Merge branch 'main' into benchmarking-overhaul
64186b46
sayakpaul
sayakpaul Merge branch 'main' into benchmarking-overhaul
dfb20b07
sayakpaul Merge branch 'main' into benchmarking-overhaul
1b0de9b4
sayakpaul separate requirements and make it nightly.
1122cad9
sayakpaul add db population script.
baa92c27
sayakpaul update secret name
9e1f17fd
sayakpaul
sayakpaul update secret.
71200da0
McPatate
sayakpaul
McPatate
sayakpaul
sayakpaul Merge branch 'main' into benchmarking-overhaul
1136f924
sayakpaul Merge branch 'main' into benchmarking-overhaul
d10024c4
sayakpaul population db update
e45e4ebc
sayakpaul disable db population for now.
4a60155d
sayakpaul Merge branch 'main' into benchmarking-overhaul
8dd326fd
DN6
DN6 commented on 2025-06-06
sayakpaul change to every monday
e0ccb602
sayakpaul Update .github/workflows/benchmark.yml
61dd029b
sayakpaul quality improvements.
ee0fcd49
sayakpaul reparate hub upload step.
e35ffe83
sayakpaul repository
d3c494a7
sayakpaul
sayakpaul commented on 2025-06-06
sayakpaul remove csv
ce8d1ec6
sayakpaul check
fc69eb86
sayakpaul update
a43e8ef7
sayakpaul update
2f5c8d07
sayakpaul threading.
1f7587e2
sayakpaul update
7a935a49
sayakpaul update
a6c7359f
sayakpaul updaye
1150cb09
sayakpaul update
6cc47073
sayakpaul update
f1ee6315
sayakpaul update
73e07baa
sayakpaul remove peft dep
2a65a891
sayakpaul upgrade runner.
dc778b00
sayakpaul fix
8ddf57cf
sayakpaul fixes
8161e36d
sayakpaul fix merging csvs.
807f5113
sayakpaul sayakpaul requested a review from DN6 DN6 246 days ago
sayakpaul Merge branch 'main' into benchmarking-overhaul
2dbdfe05
sayakpaul push dataset to the Space repo for analysis.
a09768f2
sayakpaul warm up.
1683c47b
sayakpaul Merge branch 'main' into benchmarking-overhaul
d1fb6206
sayakpaul add a readme
858dc09a
McPatate
McPatate commented on 2025-06-10
sayakpaul Apply suggestions from code review
6bfdae67
sayakpaul address feedback
6b11973c
sayakpaul sayakpaul requested a review from McPatate McPatate 243 days ago
sayakpaul
sayakpaul commented on 2025-06-10
sayakpaul Apply suggestions from code review
ba7a89c6
sayakpaul disable db workflow.
f9285fdf
sayakpaul Merge branch 'main' into benchmarking-overhaul
9017a2c9
sayakpaul Merge branch 'main' into benchmarking-overhaul
f9d43455
sayakpaul Merge branch 'main' into benchmarking-overhaul
57926083
sayakpaul Merge branch 'main' into benchmarking-overhaul
3ae040ca
sayakpaul Merge branch 'main' into benchmarking-overhaul
d9950cdb
sayakpaul
sayakpaul Merge branch 'main' into benchmarking-overhaul
9e235e8b
sayakpaul Merge branch 'main' into benchmarking-overhaul
aac27f07
DN6
DN6 approved these changes on 2025-07-02
DN6
DN6 commented on 2025-07-02
sayakpaul update to bi weekly.
6bf5b363
sayakpaul Merge branch 'main' into benchmarking-overhaul
736f22e0
sayakpaul
sayakpaul Merge branch 'main' into benchmarking-overhaul
18c43619
anijain2305
sayakpaul enable population
4bdb8650
sayakpaul enable
ca81c6e5
sayakpaul Merge branch 'main' into benchmarking-overhaul
1745e451
sayakpaul updaye
26775e51
sayakpaul update
64331b21
sayakpaul metadata
01bd03ea
sayakpaul
sayakpaul commented on 2025-07-03
McPatate
McPatate commented on 2025-07-03
sayakpaul fix
a76a236f
sayakpaul
sayakpaul sayakpaul merged e6639fef into main 219 days ago
sayakpaul sayakpaul deleted the benchmarking-overhaul branch 219 days ago
sayakpaul

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum