vllm
[Feature][Kernel] Support bitsandbytes quantization and QLoRA
#4776

Merged

[Feature][Kernel] Support bitsandbytes quantization and QLoRA #4776

mgoin merged 13 commits into vllm-project:main from bytedance-iaas:qian/qlora

chenqianfzh force pushed 1 year ago

Yard1 requested changes on 2024-05-13

chenqianfzh force pushed 1 year ago

Yard1 commented on 2024-05-23

mgoin commented on 2024-05-23

chenqianfzh force pushed 1 year ago

Yard1 commented on 2024-05-28

[model] support bitsandbytes/QLoRA (#4033)

126e816b

Merge branch 'main' into qian/qlora

f4743d01

chenqianfzh force pushed to f4743d01 1 year ago

Merge branch 'main' into qian/qlora

eba85411

Yard1 commented on 2024-05-30

update error messages

64ad1a35

Merge branch 'main' into qian/qlora

aacab4ae

Merge branch 'main' into qian/qlora

973fd63d

Merge branch 'main' into qian/qlora

1f8aea96

add comments about bitandbytes bug

161c7925

Merge branch 'main' into qian/qlora

5264d57e

Revert "add comments about bitandbytes bug"

fbdff733

add comment about bitsandbytes bug

5c25ae3b

Yard1 commented on 2024-06-01

Merge branch 'main' into qian/qlora

25b7e75c

mgoin changed the title ~~support QLoRA~~ [Feature][Kernel] Support bitsandbytes quantization and QLoRA 1 year ago

mgoin commented on 2024-06-01

update per comments

e16bcb69

Yard1 approved these changes on 2024-06-01

mgoin approved these changes on 2024-06-01

mgoin merged b9c0605a into main 1 year ago

chenqianfzh deleted the qian/qlora branch 1 year ago

Reviewers

mgoin

Yard1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

vllm [Feature][Kernel] Support bitsandbytes quantization and QLoRA #4776 Merged

[Feature][Kernel] Support bitsandbytes quantization and QLoRA #4776

vllm
[Feature][Kernel] Support bitsandbytes quantization and QLoRA
#4776

Merged