pytorch
9b2e7d3b - [Inductor] Performance smoke test - hf bert performance increased (#94088)
Commit
1 year ago[Inductor] Performance smoke test - hf bert performance increased (#94088)
therefore bumping up from 1.185 to 1.200 to better detect regression
logurl date model speedup
https://ossci-raw-job-status.s3.amazonaws.com/log/11101705328 2023-02-03T23:05:19.5738026Z hf_Bert 1.2122
https://ossci-raw-job-status.s3.amazonaws.com/log/11101331469 2023-02-03T22:54:18.0252738Z hf_Bert 1.2129
https://ossci-raw-job-status.s3.amazonaws.com/log/11101288841 2023-02-03T22:52:17.6331332Z hf_Bert 1.2189
https://ossci-raw-job-status.s3.amazonaws.com/log/11101190372 2023-02-03T22:50:28.6010460Z hf_Bert 1.2117
https://ossci-raw-job-status.s3.amazonaws.com/log/11101101525 2023-02-03T22:27:18.5573576Z hf_Bert 1.2088
https://ossci-raw-job-status.s3.amazonaws.com/log/11101034545 2023-02-03T22:24:33.8710157Z hf_Bert 1.2229
https://ossci-raw-job-status.s3.amazonaws.com/log/11101004878 2023-02-03T22:22:38.0506379Z hf_Bert 1.2074
https://ossci-raw-job-status.s3.amazonaws.com/log/11100834787 2023-02-03T22:12:34.9376779Z hf_Bert 1.2142
https://ossci-raw-job-status.s3.amazonaws.com/log/11100413479 2023-02-03T21:47:55.7536822Z hf_Bert 1.2112
https://ossci-raw-job-status.s3.amazonaws.com/log/11100372087 2023-02-03T21:46:19.6411599Z hf_Bert 1.2175
https://ossci-raw-job-status.s3.amazonaws.com/log/11100291417 2023-02-03T21:41:01.3427726Z hf_Bert 1.2068
https://ossci-raw-job-status.s3.amazonaws.com/log/11100137256 2023-02-03T21:32:14.4491714Z hf_Bert 1.2089
https://ossci-raw-job-status.s3.amazonaws.com/log/11098980986 2023-02-03T20:30:13.4082966Z hf_Bert 1.2109
https://ossci-raw-job-status.s3.amazonaws.com/log/11098634747 2023-02-03T20:12:57.4921305Z hf_Bert 1.2169
https://ossci-raw-job-status.s3.amazonaws.com/log/11096295932 2023-02-03T18:58:55.1214750Z hf_Bert 1.2196
https://ossci-raw-job-status.s3.amazonaws.com/log/11095904757 2023-02-03T18:49:48.4541355Z hf_Bert 1.22
https://ossci-raw-job-status.s3.amazonaws.com/log/11095292402 2023-02-03T18:10:54.6924201Z hf_Bert 1.2122
https://ossci-raw-job-status.s3.amazonaws.com/log/11095026691 2023-02-03T18:11:26.7384107Z hf_Bert 1.2228
https://ossci-raw-job-status.s3.amazonaws.com/log/11094943489 2023-02-03T17:53:00.0989341Z hf_Bert 1.2165
https://ossci-raw-job-status.s3.amazonaws.com/log/11093227145 2023-02-03T16:04:18.7935799Z hf_Bert 1.2208
https://ossci-raw-job-status.s3.amazonaws.com/log/11092910912 2023-02-03T15:51:28.1977577Z hf_Bert 1.2188
https://ossci-raw-job-status.s3.amazonaws.com/log/11091775528 2023-02-03T15:27:21.7984395Z hf_Bert 1.2231
https://ossci-raw-job-status.s3.amazonaws.com/log/11091768252 2023-02-03T15:12:33.0339859Z hf_Bert 1.2167
https://ossci-raw-job-status.s3.amazonaws.com/log/11091051563 2023-02-03T14:44:42.7011287Z hf_Bert 1.2214
https://ossci-raw-job-status.s3.amazonaws.com/log/11088539227 2023-02-03T12:41:29.9098435Z hf_Bert 1.2192
https://ossci-raw-job-status.s3.amazonaws.com/log/11088428613 2023-02-03T12:35:38.4674850Z hf_Bert 1.2108
https://ossci-raw-job-status.s3.amazonaws.com/log/11088405279 2023-02-03T12:34:54.0870617Z hf_Bert 1.2197
https://ossci-raw-job-status.s3.amazonaws.com/log/11087037337 2023-02-03T12:06:58.2426787Z hf_Bert 1.2174
https://ossci-raw-job-status.s3.amazonaws.com/log/11085381881 2023-02-03T10:19:20.8764019Z hf_Bert 1.2189
https://ossci-raw-job-status.s3.amazonaws.com/log/11085190037 2023-02-03T10:14:41.5234245Z hf_Bert 1.2046
https://ossci-raw-job-status.s3.amazonaws.com/log/11085016390 2023-02-03T09:50:59.7484273Z hf_Bert 1.2155
https://ossci-raw-job-status.s3.amazonaws.com/log/11084948754 2023-02-03T09:47:15.7358069Z hf_Bert 1.2083
https://ossci-raw-job-status.s3.amazonaws.com/log/11084675155 2023-02-03T09:42:35.6628268Z hf_Bert 1.2126
https://ossci-raw-job-status.s3.amazonaws.com/log/11081270865 2023-02-03T06:05:22.1828269Z hf_Bert 1.2083
https://ossci-raw-job-status.s3.amazonaws.com/log/11081252914 2023-02-03T05:43:59.0680872Z hf_Bert 1.2097
https://ossci-raw-job-status.s3.amazonaws.com/log/11081252670 2023-02-03T05:44:17.0945428Z hf_Bert 1.2143
https://ossci-raw-job-status.s3.amazonaws.com/log/11081244430 2023-02-03T05:43:43.6811750Z hf_Bert 1.2204
https://ossci-raw-job-status.s3.amazonaws.com/log/11081191493 2023-02-03T05:38:43.7833293Z hf_Bert 1.2079
https://ossci-raw-job-status.s3.amazonaws.com/log/11081191168 2023-02-03T05:38:21.1397044Z hf_Bert 1.2067
https://ossci-raw-job-status.s3.amazonaws.com/log/11081189846 2023-02-03T05:38:53.5914557Z hf_Bert 1.2073
https://ossci-raw-job-status.s3.amazonaws.com/log/11080883297 2023-02-03T05:13:25.0077772Z hf_Bert 1.2105
https://ossci-raw-job-status.s3.amazonaws.com/log/11080456108 2023-02-03T04:34:34.0934838Z hf_Bert 1.204
https://ossci-raw-job-status.s3.amazonaws.com/log/11079957300 2023-02-03T03:53:18.9091026Z hf_Bert 1.207
https://ossci-raw-job-status.s3.amazonaws.com/log/11078579407 2023-02-03T02:03:11.2254812Z hf_Bert 1.2049
https://ossci-raw-job-status.s3.amazonaws.com/log/11078204621 2023-02-03T01:58:39.0887941Z hf_Bert 1.2214
https://ossci-raw-job-status.s3.amazonaws.com/log/11078126527 2023-02-03T01:38:20.2183225Z hf_Bert 1.2061
https://ossci-raw-job-status.s3.amazonaws.com/log/11077409013 2023-02-03T00:48:51.8981496Z hf_Bert 1.2086
https://ossci-raw-job-status.s3.amazonaws.com/log/11077176061 2023-02-03T00:27:27.2594172Z hf_Bert 1.2077
https://ossci-raw-job-status.s3.amazonaws.com/log/11077075809 2023-02-03T00:21:54.4916449Z hf_Bert 1.2103
https://ossci-raw-job-status.s3.amazonaws.com/log/11076629886 2023-02-02T23:50:38.3512367Z hf_Bert 1.2191
https://ossci-raw-job-status.s3.amazonaws.com/log/11076577074 2023-02-02T23:46:06.5987589Z hf_Bert 1.2061
https://ossci-raw-job-status.s3.amazonaws.com/log/11076403972 2023-02-02T23:35:49.7931367Z hf_Bert 1.2088
https://ossci-raw-job-status.s3.amazonaws.com/log/11076234469 2023-02-02T23:25:55.7300688Z hf_Bert 1.2099
https://ossci-raw-job-status.s3.amazonaws.com/log/11075752070 2023-02-02T22:57:25.4280216Z hf_Bert 1.2048
https://ossci-raw-job-status.s3.amazonaws.com/log/11074434992 2023-02-02T22:10:58.4127805Z hf_Bert 1.2084
https://ossci-raw-job-status.s3.amazonaws.com/log/11074370082 2023-02-02T22:10:06.8153498Z hf_Bert 1.2075
https://ossci-raw-job-status.s3.amazonaws.com/log/11073914614 2023-02-02T21:25:53.3262334Z hf_Bert 1.2058
https://ossci-raw-job-status.s3.amazonaws.com/log/11073616418 2023-02-02T21:12:03.0024412Z hf_Bert 1.2053
https://ossci-raw-job-status.s3.amazonaws.com/log/11072632121 2023-02-02T20:25:37.5689220Z hf_Bert 1.2082
https://ossci-raw-job-status.s3.amazonaws.com/log/11072091471 2023-02-02T20:00:08.5175281Z hf_Bert 1.2079
https://ossci-raw-job-status.s3.amazonaws.com/log/11069395867 2023-02-02T18:29:04.6481423Z hf_Bert 1.2071
https://ossci-raw-job-status.s3.amazonaws.com/log/11069169921 2023-02-02T18:18:36.5701242Z hf_Bert 1.2036
https://ossci-raw-job-status.s3.amazonaws.com/log/11069070631 2023-02-02T18:15:32.2345859Z hf_Bert 1.2055
https://ossci-raw-job-status.s3.amazonaws.com/log/11067153829 2023-02-02T16:38:27.4201129Z hf_Bert 1.2133
https://ossci-raw-job-status.s3.amazonaws.com/log/11066885021 2023-02-02T16:28:44.4489971Z hf_Bert 1.2043
The above are the result of running a rockset query which returns links to the log and wget the logs and grep "Z hf_Bert"
Pull Request resolved: https://github.com/pytorch/pytorch/pull/94088
Approved by: https://github.com/desertfire
Author
Committer
Parents
Loading