text-generation-inference
fix(server): fix quantization for sharded models
#45
Merged

fix(server): fix quantization for sharded models #45

OlivierDehaene merged 2 commits into main from fix/quantize
OlivierDehaene
OlivierDehaene fix(server): fix quantization for sharded models
ca11e9e8
OlivierDehaene formatting
4858f122
OlivierDehaene OlivierDehaene merged c6e8b944 into main 3 years ago
OlivierDehaene OlivierDehaene deleted the fix/quantize branch 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone