PR #7061 CUDA: generalize FP16 fattn vec kernel - SemanticDiff

Commits

CUDA: generalize FP16 fattn vec kernel

JohannesGaessler committed 1 year ago
disable unsupported head sizes for AMD in test

JohannesGaessler committed 1 year ago
try AMD fix

JohannesGaessler committed 1 year ago
fix batch size 2-8

JohannesGaessler committed 1 year ago
partially revert changes

JohannesGaessler committed 1 year ago
fix performance regression

JohannesGaessler committed 1 year ago
fix compiler warning

JohannesGaessler committed 1 year ago

Loading