cog
b99774f1 - Modify base image struct

Commit
1 year ago
Modify base image struct To improve model startup performance, we are providing a set of pre-built image based based on a combination of python, pytorch and CUDA versions. The current version stores all the versions as a flat list and it makes a bit hard to reason about combinations and provide user with feedback on what versions are available. The change here makes Python the top level key and store all the CUDA and PyTorch versions available for each Python version. It would be possible to normalize the struct more to represent the relationship between CUDA, Python but PyTorch but I don't know if that's worth doing at this point. The work here is WIP but sharing it for feedback. Signed-off-by: Marcus Martins <marcus@replicate.com>
Author
Committer
Parents
Loading