Add support for per-dtype `kv_cache_dtype` - SemanticDiff

Commit

1 year ago

Add support for per-dtype `kv_cache_dtype`

References

#545 - 🚀🚀🚀 Transformers.js V3 🚀🚀🚀

Author

xenova

xenova

Parents

Loading