Support `e4m3fn` KV cache (#2655)

Commit

1 year ago

Support `e4m3fn` KV cache (#2655) * Support `e4m3fn` KV cache * Make check more obvious