PR #541 Fix VLLM data-parallel

Fix VLLM data-parallel #541

hynky1999 merged 7 commits into main from fix_ray

make bleur lazy

46d15857

make tokenizer lazy too

05795e04

fix_ray

3aea70ed

fix tensor_paralel > 1

c95457f8

Merge remote-tracking branch 'origin/main' into fix_ray

1b1d74c9

remove debug statements

db293d3b

hynky1999 requested a review from

lewtun 1 year ago

hynky1999 requested a review from

NathanHB 1 year ago

clefourrier commented on 2025-02-06

lewtun approved these changes on 2025-02-06

bump vllm

ce853a34

hynky1999 merged 86f62259 into main 1 year ago

Reviewers

lewtun

clefourrier

NathanHB

Assignees

No one assigned

Labels

None yet

Milestone

No milestone