onnxruntime
Update gpt2 benchmark with position_ids and fp16
#4275
Merged
Overview
Commits
10
Changes
View On GitHub

Update gpt2 benchmark with position_ids and fp16 #4275

tianleiwu merged 10 commits into master from tlwu/benchmark_gpt2_past_mask
tianleiwu
tianleiwu Update script
45c6158f
tianleiwu change assert cuda output to log error
8cf34bec
tianleiwu Remove the useless check that output of matmul is in cuda
04d7462d
tianleiwu allocate buffer once only
a67f7d6f
tianleiwu Merge remote-tracking branch 'origin/master' into tlwu/benchmark_gpt2…
56e35403
tianleiwu Remove get_example
6addac78
tianleiwu tianleiwu added GPT2
tianleiwu tianleiwu requested a review from liuziyue liuziyue 6 years ago
tianleiwu tianleiwu requested a review from yufenglee yufenglee 6 years ago
tianleiwu tianleiwu requested a review 6 years ago
tianleiwu output results to csv file
73a6905d
tianleiwu support fp16 conversion for gpt2 past state
c033538d
tianleiwu Add test for fp16 conversion of gpt2 past
f025bd8e
tianleiwu tianleiwu changed the title Update gpt2 benchmark with position_ids input Update gpt2 benchmark with position_ids and fp16 6 years ago
tianleiwu fix typo
aee1da39
liuziyue
liuziyue commented on 2020-06-19
liuziyue
liuziyue approved these changes on 2020-06-19
tianleiwu tianleiwu merged 466511c1 into master 6 years ago
tianleiwu tianleiwu deleted the tlwu/benchmark_gpt2_past_mask branch 6 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum