PR #286 Do not load the entire array while converting to save on RAM.

Do not load the entire array while converting to save on RAM. #286

OlivierDehaene merged 2 commits into main from reduce_memory_on_convert

Do not load the entire array while converting to save on RAM.

872757bf

OlivierDehaene commented on 2023-05-05

Update server/text_generation_server/utils/convert.py

9e48730e

OlivierDehaene approved these changes on 2023-05-05

OlivierDehaene merged b4aa87db into main 2 years ago

OlivierDehaene deleted the reduce_memory_on_convert branch 2 years ago

Reviewers

OlivierDehaene

Assignees

No one assigned

Labels

None yet

Milestone

No milestone