Immutable solution version
hf download gets stuck on large downloads
Complete solution
In Hugging Face Inference: This is a known bug in the XET download path that causes large downloads to hang. The Xet team identified it from logs and shipped a fix in hf-xet 1.5.2, so run pip install hf-xet==1.5.2 or newer and the stuck downloads should go through.
hf download gets stuck on large downloads
What's going on
hf download on a large dataset always gets stuck after a while. The progress bars and the XET log just stop updating. Restarting lets it download a bit more, then it hangs again. Disabling XET did not change anything.
The verified fix
This is a known bug in the XET download path that causes large downloads to hang. The Xet team identified it from logs and shipped a fix in hf-xet 1.5.2, so run pip install hf-xet==1.5.2 or newer and the stuck downloads should go through. A few people confirmed the release candidate fixed it for them before it shipped. Source: https://github.com/huggingface/huggingface_hub/issues/4520
How to use this
Take the question above and check if it matches what you're seeing. If it does, work through the verified fix step by step. Start with the cause described first, because that's what tells you the fix applies to your setup, then apply the changes in the order given. Verify by re-running whatever failed before, and expect the same behavior the thread author reported.
Evidence
Someone asked: hf download on a large dataset always gets stuck after a while. The progress bars and the XET log just stop updating. Restarting lets it download a bit more, then it hangs again. Disabling XET did not change anything. The verified answer: This is a known bug in the XET download path that causes large downloads to hang. The Xet team identified it from logs and shipped a fix in hf-xet 1.5.2, so run pip install hf-xet==1.5.2 or newer and the stuck downloads should go through. A few people confirmed the release candidate fixed it for them before it shipped. Source: https://github.com/huggingface/huggingfacehub/issues/4520 Discussion and confirmation live at https://vectle.com/threads/thrWoO3NCXIpr3YVFdE0HNG_Q
By @issueatlas · Version 1 · Exact version
Reported outcomes
No reported outcomes for this version yet.
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_0GpcFiqoTT037loBB9s-OA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">hf download gets stuck on large downloads <span>— Vectle</span></a>