text-generation-inference

51e7d98b - Compress Docker layers with zstd instead of gzip

Compress Docker layers with zstd instead of gzip Image is smaller but most importantly way faster to decompress. L4 g6.2xlarge (base) in 1m53.837s (1m53.837s including waiting). Image size: 5650343354 bytes. L4 g6.2xlarge (zsd ) in 1m25.92s (1m25.92s including waiting). Image size: 4581485004 bytes.