Add RoCm support #1243

Narsil merged 32 commits into main from tgi-rocm
fxmarty
working rocm build
52bdcf79
clean rocm support
ea8438a5
cleaning
24469287
fix tests
0f7b9bba
fxmarty fxmarty requested a review from OlivierDehaene OlivierDehaene 2 years ago
fxmarty fxmarty removed review request from OlivierDehaene OlivierDehaene 2 years ago
fxmarty fxmarty requested a review from Narsil Narsil 2 years ago
fxmarty fxmarty requested a review from OlivierDehaene OlivierDehaene 2 years ago
OlivierDehaene
OlivierDehaene commented on 2023-11-08
fxmarty Update server/text_generation_server/models/custom_modeling/flash_lla…
f746b8e0
fxmarty
fxmarty commented on 2023-11-08
fxmarty Update server/text_generation_server/models/custom_modeling/flash_mis…
891fe740
fxmarty Update server/text_generation_server/models/custom_modeling/flash_mis…
0eea83be
fxmarty
fxmarty commented on 2023-11-08
fxmarty Update server/text_generation_server/models/custom_modeling/idefics_m…
6353a87f
update on review
80ce8910
Narsil
Narsil commented on 2023-11-08
fxmarty
OlivierDehaene
OlivierDehaene commented on 2023-11-08
move controlflow in forward
8617d479
fxmarty
fix wrong refactor of rope
a992084b
Merge branch 'main' into tgi-rocm
7903ad72
add image build workflow step
52c0e0e5
fxmarty
OlivierDehaene
OlivierDehaene
fxmarty
OlivierDehaene
OlivierDehaene
OlivierDehaene commented on 2023-11-15
OlivierDehaene
fxmarty Update .github/workflows/build.yaml
8e07a248
use modified vllm rope kernel when using rocm
736e1997
Merge branch 'tgi-rocm' of https://github.com/huggingface/text-genera…
ddf0c858
fxmarty
fxmarty
fxmarty commented on 2023-11-16
update doc
eb0e9378
fxmarty fxmarty requested a review from Narsil Narsil 2 years ago
fxmarty fxmarty requested a review from OlivierDehaene OlivierDehaene 2 years ago
fxmarty
fxmarty commented on 2023-11-16
fxmarty Merge branch 'main' into tgi-rocm
7052827b
is concurrency the reason for cancelled job?
2a644b53
+rocm as a docker tag seems illegal
b6e5c28d
remove broken cosign
bb638fe5
github.job is null only available within steps
1b0236cb
Narsil
fxmarty
fxmarty Merge branch 'main' into tgi-rocm
3126055e
fix bug on cuda build
bdb6c9d1
Merge branch 'tgi-rocm' of https://github.com/huggingface/text-genera…
a11e4c06
fxmarty Merge branch 'main' into tgi-rocm
5e635679
fxmarty remove requirements_common
e0abb576
clean doc
d4e2ca08
format
f271be41
fxmarty Merge branch 'main' into tgi-rocm
99a20757
OlivierDehaene
OlivierDehaene commented on 2023-11-24
fxmarty latest=false
8aef3992
fxmarty
OlivierDehaene
fxmarty cargo fmt
b7dba161
fxmarty
fxmarty fxmarty requested a review from OlivierDehaene OlivierDehaene 2 years ago
Narsil
Narsil Narsil merged b2b5df0e into main 2 years ago
Narsil Narsil deleted the tgi-rocm branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone