pytorch/benchmark

Pull Requests Commits

Fix leftover __init__ to run mishap

janeyx99 committed 2 years ago

3eb3ab43

[test] print args and models

janeyx99 committed 2 years ago

7388a991

Fix the warnings from deprecating APIs or missing environment variables (#1735)

xuzhao9 committed 2 years ago

d3eab4bb

Download the input data ondemand (#1734)

xuzhao9 committed 2 years ago

e5bf5f0c

Add PT2 compilation time metric and remove eager-speedup metric

xuzhao9 committed 2 years ago

ebb6784d

Update python_utils.py (#1718)

johnnynunez committed 2 years ago

efc8d060

Bump transformers from 4.27.4 to 4.30.0 (#1731)

dependabot[bot] committed 2 years ago

790e646b

Add throughputs metric and enable in cpu userbenchmark (#1727)

chuanqi129 committed 2 years ago

7619bb8c

replace np.int with int [2]

igorsugak committed 2 years ago

b50703d5

Add model kwargs (#1729)

anijain2305 committed 2 years ago

72dcbd91

Fix bisection failures (#1722)

xuzhao9 committed 2 years ago

b0f75ea8

Move torchrec_dlrm to canary models (#1725)

xuzhao9 committed 2 years ago

a933ccd9

Fix the failed unit test on A100 (#1720)

xuzhao9 committed 2 years ago

cb91cd1f

Migrate to use run.py

xuzhao9 committed 2 years ago

8526eabb

Moco Inplace Update Params (#1693)

eellison committed 2 years ago

66050c23

Add bisection for userbenchmarks (#1638)

xuzhao9 committed 2 years ago

db37ddda

Add cpu_peak_mem and gpu_peak_mem to the metrics

xuzhao9 committed 2 years ago

59dbaaaa

Improve the regression detector to generate bisection config (#1710)

xuzhao9 committed 2 years ago

1734a5d8

always upload stats to s3+scribe (#1711)

janeyx99 committed 2 years ago

db3e43ec

Migrate to use the correctness checking code in dynamo torchbench.py (#1700)

xuzhao9 committed 2 years ago

9a58c643

Add metrics param for cpu userbenchmark (#1674)

chuanqi129 committed 2 years ago

df27114e

Fix a bug in S3 upload script (#1684)

xuzhao9 committed 2 years ago

611bb442

Set the correct grad mode for train and eval correctness tests

xuzhao9 committed 2 years ago

c1408a3a

add sam to dense_models, retitle issues (#1688)

janeyx99 committed 2 years ago

0e663c85

Support downloading yaml files from S3 (#1685)

xuzhao9 committed 2 years ago

c596059b

Remove redundant dependency (#1686)

spzala committed 2 years ago

d40fff39

Set threshold to 30% and disable torch-nightly unstable models (#1681)

janeyx99 committed 2 years ago

3f2a2a15

Upload the regression file to Amazon S3 (#1679)

xuzhao9 committed 2 years ago

9504651c

Add feature to run nightly with regression yaml (#1677)

xuzhao9 committed 2 years ago

d0a05378

Add SAM (#1661)

msaroufim committed 2 years ago

cc53ec65

Older