refactor and add low latency code

Commit

100 days ago

refactor and add low latency code Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>