hub-docs
e6f63f7c - [Xet] Document adaptive concurrency for xet transfers (#2260)

Commit
131 days ago
[Xet] Document adaptive concurrency for xet transfers (#2260) * [Xet] Document adaptive concurrency for xet transfers Describe the adaptive concurrency feature that xet-core uses by default to dynamically adjust parallelism based on network conditions. Update HF_XET_HIGH_PERFORMANCE documentation to reflect that it now raises adaptive concurrency bounds (initial=16, max=124) rather than setting fixed values. Add HF_XET_FIXED_DOWNLOAD/UPLOAD_CONCURRENCY as advanced escape hatches. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * [Xet] Add environment variables reference for xet-core configuration Add a comprehensive "Environment Variables" section to the Xet storage docs covering adaptive concurrency, network/retry, data transfer, download buffers, and logging. All variable names and defaults verified against xet-core source. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * [Xet] Address review feedback: reframe HP mode as advanced option - Clarify that default adaptive concurrency already saturates most network paths — no tuning needed for most users - Document HF_XET_HIGH_PERFORMANCE as requiring >=64 GB RAM, warn it may degrade performance on smaller machines - Mark adaptive concurrency env vars as advanced settings - Fix AC_TARGET_RTT description per reviewer suggestion Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> * [Xet] Address remaining review feedback from PR #2260 Remove redundant pip install line and fix code fence language tag. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Author
Parents
Loading