auto-round
support bf16 inference for autoround format
#420
Merged

support bf16 inference for autoround format #420

n1ck-guo merged 1 commit into main from bf16_inference
wenhuach21
wenhuach21 support bf16 inference
1344c506
n1ck-guo n1ck-guo requested a review from n1ck-guo n1ck-guo 357 days ago
n1ck-guo
n1ck-guo approved these changes on 2025-01-20
n1ck-guo n1ck-guo merged 29c5119f into main 357 days ago
n1ck-guo n1ck-guo deleted the bf16_inference branch 357 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone