text-generation-inference
fix(rust-client): use join_all instead of select_all to hopefully fix nccl issues
#162

Merged

fix(rust-client): use join_all instead of select_all to hopefully fix nccl issues #162

OlivierDehaene merged 2 commits into main from fix/sync_shard_client

feat(docker): improve flash_attention caching

98094f4d

fix(rust-client): use join_all instead of select_all

3e1a281f

OlivierDehaene merged 5cddc055 into main 3 years ago

OlivierDehaene deleted the fix/sync_shard_client branch 3 years ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone