DeepSpeed
Engine side fix for loading llama checkpoint fine-tuned with zero3
#3981

Merged

Engine side fix for loading llama checkpoint fine-tuned with zero3 #3981

mrwyattii merged 5 commits into master from mz/llama-support

Engine side fix for loading llama checkpoint fine-tuned with zero3

056d959d

minjiaz requested a review from

RezaYazdaniAminabadi 2 years ago

minjiaz requested a review from

jeffra 2 years ago

minjiaz requested a review from

mrwyattii 2 years ago

minjiaz requested a review from

awan-10 2 years ago

minjiaz requested a review from

cmikeh2 2 years ago

minjiaz requested a review from

arashb 2 years ago

mrwyattii commented on 2023-07-18

XuehaiPan commented on 2023-07-24

Fixes to support llama fine-tuning in ds-chat

fe7503b7

Refactored the code to avoid using an except block.

7a8088a4

XuehaiPan commented on 2023-07-25

formatting

43787da9

revert permissions change

aefe0746

mrwyattii approved these changes on 2023-07-26

mrwyattii enabled auto-merge 2 years ago

mrwyattii merged 15f94ae7 into master 2 years ago

Reviewers

mrwyattii

XuehaiPan

jeffra

awan-10

cmikeh2

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone