vllm
5125d72f - [Model] use AutoWeightsLoader for olmoe,opt,orion,persimmon,phi3_small (#16548)

Commit

1 year ago

[Model] use AutoWeightsLoader for olmoe,opt,orion,persimmon,phi3_small (#16548) Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>

References

Author

lengrongfu

Parents