text-generation-inference
feat: update exllamav2 kernels
#1370
Merged
Overview
Commits
6
Changes
View On GitHub

feat: update exllamav2 kernels #1370

Narsil merged 6 commits into main from feat/update_exllamav2_kernels
OlivierDehaene
OlivierDehaene feat: update exllamav2 kernels
38df4c1d
OlivierDehaene fmt
672f2909
OlivierDehaene OlivierDehaene force pushed from 1478c1d6 to 672f2909 2 years ago
OlivierDehaene remove v2 for now
96a520ec
OlivierDehaene back to v2 by def
238cc311
Narsil Preventing using exllama when act_order=True
9f42e5f6
Narsil Fix santacoder.
d3b5ae27
Narsil Narsil merged 564199ba into main 2 years ago
Narsil Narsil deleted the feat/update_exllamav2_kernels branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum