Fixing several bugs in the inference-api and the kernels #1951
jeffra
merged
15 commits into
master
from
fix-gpt-inference
fixing several bugs in the inference-api and the kernels
7707cbce
formatting
1aa5816d
add hf inference unit test
7447cee3
update unit tests for fp32/16
a2edb1d3
skip test for now, needs debugging
773a2581
Merge branch 'master' into fix-gpt-inference
5fcfe1b0
Merge branch 'master' into fix-gpt-inference
fc868e3a
fix rotary_pos embedding for GPT-J inderence
6908fb15
Merge branch 'fix-gpt-inference' of github.com:microsoft/DeepSpeed in…
f931bb91
turn unit test back on
94a6ca43
fix for gpt-j fp16 ckpt revision
af24e619
add injection workaround for pt1.2
29c2a246
fix for amd
d290b019
fix for megatron + pt1.2
5dce777b
skip on torch 1.2, several issues there
51e5c012
jeffra
approved these changes
on 2022-05-24
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub