text-generation-inference
Do not initialize scratch space when there are no ExLlamaV2 layers
#2015

Merged

Do not initialize scratch space when there are no ExLlamaV2 layers #2015

Narsil merged 1 commit into main from bugfix/skip-exllama-when-no-layers

Do not initialize scratch space when there are no ExLlamav2 layers

0777749d

Narsil approved these changes on 2024-06-05

Narsil merged 9ffe1f1e into main 1 year ago

Narsil deleted the bugfix/skip-exllama-when-no-layers branch 1 year ago

Reviewers

Narsil

Assignees

No one assigned

Labels

None yet

Milestone

No milestone