cog
9efb3069 - Add fast generator for cog build (#2108)

Commit
349 days ago
Add fast generator for cog build (#2108) * Add fast generator * Add copy weights step * Add package installation step * Add user cache to the monobase * Resolve monobase caching into the local userspace to allow for monobase caching between builds * Add rsync copy * Check if weight files have changed before checksum * Split install into separate steps * We can get the tarballs for each of these layers instead of creating 1 big tarball. * Create requirements.txt in the build tmp directory * Fix unit tests * Fix lint * Add basic unit tests * Use UV_CACHE_DIR and mount uv cache * Remove —skip-cuda from monobase build * Monobase now handles empty CUDA env vars * Fix file not found when evaluating weights * Add UV_LINK_MODE=copy to the uv install commands * Add UV_COMPILE_BYTECODE env var * Remove verbosity from monobase exec * Fix integration test * Switch tini and exec --------- Signed-off-by: Will Sackfield <sackfield@replicate.com>
Author
Parents
Loading