chat-ui
4e6e1bd5 - Cache models to avoid redundant dynamic imports

Commit
108 days ago
Cache models to avoid redundant dynamic imports Introduces a module-level cache for models in endpoint.ts to prevent repeated dynamic imports on every request. This improves performance by loading models only once and reusing them for subsequent calls.
Author
Parents
Loading