fix ubatch datatype issue - SemanticDiff

Commit

251 days ago

fix ubatch datatype issue Signed-off-by: yewentao256 <zhyanwentao@126.com>

References

#23693 - [Core/DBO][1/N] Add Dual-Batch Overlap mechanism to VLLM

Author

yewentao256

yewentao256

Parents

Loading