onnxruntime
Fix integer overflow in cuda NonMaxSuppression implementation
#2540

Merged

Fix integer overflow in cuda NonMaxSuppression implementation #2540

fs-eire merged 3 commits into master from fs-eire/nms-cuda-fix

add test case that should pass but fail

606eaf5d

fix nms

27e5f817

fs-eire requested a review 6 years ago

ybrnathan commented on 2019-12-04

ybrnathan requested changes on 2019-12-04

extract int_max_output_boxes_per_class

ea3bdcee

ybrnathan approved these changes on 2019-12-04

yufenglee approved these changes on 2019-12-04

fs-eire merged be56d77a into master 6 years ago

fs-eire deleted the fs-eire/nms-cuda-fix branch 6 years ago

Reviewers

yufenglee

ybrnathan

Assignees

No one assigned

Labels

None yet

Milestone

No milestone