pytorch/benchmark

Pull Requests Commits

clean up and add checkpointing

erichan1 committed 3 years ago

95ffc83f

also part of adding ability to run different tasks

erichan1 committed 3 years ago

437969d0

added eval_metric return and added ability to run different tasks through --task_name

erichan1 committed 3 years ago

1bbb06ad

add eval to e2e t5 benchmark

erichan1 committed 3 years ago

ee97ec34

add first working version of T5 and wmt16 dataset for T5 translation training

erichan1 committed 3 years ago

7c3090b1

Torchbench - explicitly enable JIT profiling executor (#1095)

davidberard98 committed 3 years ago

b83bd2be

add support for Execution Graph (#1077)

FindHao committed 3 years ago

6291bc09

Fix DLRM batch size argument to be mini_batch_size (#1082)

aaronenyeshi committed 3 years ago

9b9668fa

Enable flops for torchvision models (#748)

xuzhao9 committed 3 years ago

bf84f487

Update torchdynamo backend for torchbench (#1091)

davidberard98 committed 3 years ago

6d6d904b

shorten output format (#1073)

zzpmiracle committed 3 years ago

7ffb6e72

args.jit -> model.jit (#1086)

davidberard98 committed 3 years ago

97393f44

Handle models that don't have metadata.yaml (e.g. internal models) (#1085)

davidberard98 committed 3 years ago

d1fccd8b

seperate atol and rtol in correct check and read tol from os.env (#1072)

zzpmiracle committed 3 years ago

8a7d09d1

Fix eval batch size on Nvidia A100 40GB (#1078)

xuzhao9 committed 3 years ago

0e1a1885

Improve the release test by fixing bugs and add result analyzer (#1069)

xuzhao9 committed 3 years ago

8a7bbec9

Add release testing userbenchmark with multiple cuda versions (#1067)

xuzhao9 committed 3 years ago

3ffb2005

Make it easier to add more backends (#1059)

xuzhao9 committed 3 years ago

d9fa6b8d

Add `--output` option to userbenchmark/nvfuser (#1062)

xwang233 committed 3 years ago

305152cf

Upload userbenchmark result to Scribe (#1061)

xuzhao9 committed 3 years ago

654a7f6c

Remove niter for models (#1054)

xuzhao9 committed 3 years ago

b743a9bb

fix a printout bug; remove default memory monitoring (#1049)

FindHao committed 3 years ago

7bdb8322

Enable 'binned' dynamic shapes for hf models (#1050)

wconstab committed 3 years ago

2ebc1c03

Support probing the best batch size for inference tests (#1027)

FindHao committed 3 years ago

4a35c22a

fix batch size problem (#1045)

zzpmiracle committed 3 years ago

bc7b200f

Add ctr_mbl_feed_30x model

xuzhao9 committed 3 years ago

1063f311

fix explanations for PCIERX/PCIETX (#1043)

FindHao committed 3 years ago

8c50b668

update transformers to 4.20.1 (#1025)

FindHao committed 3 years ago

2e0ff47e

Support DDP in the core model set (#1031)

xuzhao9 committed 3 years ago

b6b19a9f

Add userbenchmark workflow (#1013)

xuzhao9 committed 3 years ago

86638bed

Older