vllm
a6be75db - [Core] NGram GPU Implementation compatible with Async Scheduler (#29184)

Commit

6 days ago

[Core] NGram GPU Implementation compatible with Async Scheduler (#29184)

References

#29184 - [Core] NGram GPU Implementation compatible with Async Scheduler

Author

PatchouliTIS

PatchouliTIS

Parents

Loading