set v4 of vmem_limit_bytes to 16MB - SemanticDiff

Commit

254 days ago

set v4 of vmem_limit_bytes to 16MB

References

#8922 - Add heuristic default block sizes for different cases in ragged attention kernel

Author

yaochengji

yaochengji

Committer

yaochengji

yaochengji

Parents

Loading