text-generation-inference
Basic flashinfer 0.2 support
#2862
Merged

Basic flashinfer 0.2 support #2862

danieldk merged 7 commits into main from flashinfer-0.2
danieldk
danieldk Basic flashinfer 0.2 support
41c9973d
danieldk danieldk force pushed from 41c9973d to f4e510b5 1 year ago
danieldk Update to flashinfer 0.2.0.post1
02e3dc49
danieldk flashinfer: remove `contiguous` calls
6defe57d
danieldk danieldk force pushed from f4e510b5 to 6defe57d 1 year ago
danieldk Fix flashinfer install
41948e24
danieldk flashinfer: fixup kv cache dtype
4e699026
danieldk Fix some annoying perturbations
eb4d3435
danieldk More output changes
74788083
drbh
drbh approved these changes on 2025-01-09
danieldk danieldk merged a9c7d2e3 into main 1 year ago
danieldk danieldk deleted the flashinfer-0.2 branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone