Megatron-DeepSpeed

0125aaa7 - Fix inconsistent merge (#30)

Fix inconsistent merge (#30) * I suspect this was wrong * Take in account offset * Woops Co-authored-by: Thomas <ö95242+thomasw21@users.noreply.github.com>