PR #11579 [misc] Add LoRA kernel micro benchmarks

[misc] Add LoRA kernel micro benchmarks #11579

mgoin merged 17 commits into vllm-project:main from neuralmagic:varun/lora-micro-benchmarks

jeejeelee commented on 2024-12-31

varun-sundar-rabindranath force pushed 347 days ago

varun-sundar-rabindranath commented on 2025-01-07

jeejeelee commented on 2025-01-08

varun-sundar-rabindranath force pushed to 7dc85ef6 344 days ago

varun-sundar-rabindranath commented on 2025-01-09

jeejeelee commented on 2025-01-13

jeejeelee approved these changes on 2025-01-15

add lora benchmark files

b752e81d

format

d66a4b09

fix

2406afc6

add output directory

5b437881

fix num slices

e356facf

format

bcc15188

add expand_fn_add_inputs arg

96332eef

format

75ca94d5

add test_correctness

f8c900ef

add correctness testing and prints

d9aadfac

use stream capture

75ca40b7

format

c7d6620c

fix comment print

06127d3c

add comments

433d1298

refactor

faebdc99

fix example commands

1b412912

fix imports

e31e1fda

varun-sundar-rabindranath force pushed from af63ecfd to e31e1fda 338 days ago

mgoin approved these changes on 2025-01-16

mgoin enabled auto-merge (squash) 337 days ago

github-actions added ready

mgoin merged 5fd24ec0 into main 337 days ago

Reviewers

mgoin

jeejeelee

Assignees

No one assigned

Labels

ready

Milestone

No milestone

vllm [misc] Add LoRA kernel micro benchmarks #11579 Merged

[misc] Add LoRA kernel micro benchmarks #11579

vllm
[misc] Add LoRA kernel micro benchmarks
#11579

Merged