PR #4659 Add safetensors support

Add safetensors support #4659

mrwyattii merged 14 commits into deepspeedai:master from ngitnenlim:add-safetensors-support

add safetensors support

ce3a0756

ngitnenlim requested a review from

RezaYazdaniAminabadi 2 years ago

ngitnenlim requested a review from

jeffra 2 years ago

ngitnenlim requested a review from

mrwyattii 2 years ago

ngitnenlim requested a review from

awan-10 2 years ago

ngitnenlim requested a review from

cmikeh2 2 years ago

ngitnenlim requested a review from

arashb 2 years ago

Merge branch 'master' into add-safetensors-support

64bf60e3

fix formatting

7d4cce26

Merge branch 'master' into add-safetensors-support

b4e45833

Merge branch 'master' into add-safetensors-support

cf4b6ce5

mrwyattii commented on 2023-11-14

new argument prioritize_safetensors; no more duplicate downloads

4460de9f

Merge branch 'microsoft:master' into add-safetensors-support

66801d60

Merge branch 'microsoft:master' into add-safetensors-support

18c3d872

remove prioritize_safetensors argument; fetch .safentensors by default

08238b98

Update huggingface_engine.py

e38ac092

mrwyattii approved these changes on 2023-11-21

Merge branch 'master' into add-safetensors-support

70becace

Merge branch 'master' into add-safetensors-support

9a6a8651

Merge branch 'master' into add-safetensors-support

33548f9b

loadams approved these changes on 2023-11-29

Merge branch 'master' into add-safetensors-support

2d1ae1a5

mrwyattii merged 7122362f into master 2 years ago

Reviewers

loadams

mrwyattii

RezaYazdaniAminabadi

jeffra

awan-10

cmikeh2

arashb

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

DeepSpeed Add safetensors support #4659 Merged

Add safetensors support #4659

DeepSpeed
Add safetensors support
#4659

Merged