Increase the chunk size for faster download (#1267)
* Increase the chunk size for faster download
- Larger chunk help reduce overhead
- Not too large chunks so resume still works
In my very small testing I get much better download speeds already with cloudfront.
Download times go for `gpt2` from ~5s+ to ~2s- (tested both on AWS and dgx).
Testing setup:
```python
from huggingface_hub import hf_hub_download
filename = hf_hub_download("gpt2", "pytorch_model.bin", force_download=True, cache_dir="/mnt/ramdisk/")
print(filename)
```
Using a tmpfs part of the disk avoids actually writing to disk and taking it into account.
* fix displayed filename in progress bar for CDN files
Co-authored-by: Lucain Pouget <lucainp@gmail.com>
