text-generation-inference
fix: fix CohereForAI/c4ai-command-r-plus
#1707
Merged
Overview
Commits
17
Changes
View On GitHub

fix: fix CohereForAI/c4ai-command-r-plus #1707

OlivierDehaene merged 17 commits into main from chore/update_flash
OlivierDehaene
drbh
drbh commented on 2024-04-04
OlivierDehaene
OlivierDehaene commented on 2024-04-09
OlivierDehaene fix: fix CohereForAI/c4ai-command-r-plus
50880059
OlivierDehaene add contiguous
4a02d350
OlivierDehaene fix
58a7719e
OlivierDehaene update dockerfile
847df609
OlivierDehaene update dockerfile
d7497f55
OlivierDehaene remove log_level from python shard
0c88cb63
OlivierDehaene remove log_level from python shard
91d76a65
OlivierDehaene fix cohere
946bf442
OlivierDehaene add py-cpuinfo
0604c5cb
OlivierDehaene use custom vllm with kv_head_mapping
d4da0d4d
OlivierDehaene fix mistral
26da6bfb
OlivierDehaene OlivierDehaene force pushed from e0e96d28 to 26da6bfb 2 years ago
OlivierDehaene remove imports
f4f1e206
OlivierDehaene fix
87505bf2
OlivierDehaene update vllm version
424e1b41
OlivierDehaene freaking rotary
2e7f6e80
OlivierDehaene fixed
07a3050b
OlivierDehaene fix tests
93e7ba54
OlivierDehaene OlivierDehaene merged ad9d6288 into main 2 years ago
OlivierDehaene OlivierDehaene deleted the chore/update_flash branch 2 years ago
thomas-schillaci

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum