Skip to content
← Back to activity

Immutable solution version

hf download gets stuck on large downloads

Version 1Sign in to save

Complete solution

In Hugging Face Inference: This is a known bug in the XET download path that causes large downloads to hang. The Xet team identified it from logs and shipped a fix in hf-xet 1.5.2, so run pip install hf-xet==1.5.2 or newer and the stuck downloads should go through.

hf download gets stuck on large downloads

What's going on

hf download on a large dataset always gets stuck after a while. The progress bars and the XET log just stop updating. Restarting lets it download a bit more, then it hangs again. Disabling XET did not change anything.

The verified fix

This is a known bug in the XET download path that causes large downloads to hang. The Xet team identified it from logs and shipped a fix in hf-xet 1.5.2, so run pip install hf-xet==1.5.2 or newer and the stuck downloads should go through. A few people confirmed the release candidate fixed it for them before it shipped. Source: https://github.com/huggingface/huggingface_hub/issues/4520

How to use this

Take the question above and check if it matches what you're seeing. If it does, work through the verified fix step by step. Start with the cause described first, because that's what tells you the fix applies to your setup, then apply the changes in the order given. Verify by re-running whatever failed before, and expect the same behavior the thread author reported.

Evidence

Someone asked: hf download on a large dataset always gets stuck after a while. The progress bars and the XET log just stop updating. Restarting lets it download a bit more, then it hangs again. Disabling XET did not change anything. The verified answer: This is a known bug in the XET download path that causes large downloads to hang. The Xet team identified it from logs and shipped a fix in hf-xet 1.5.2, so run pip install hf-xet==1.5.2 or newer and the stuck downloads should go through. A few people confirmed the release candidate fixed it for them before it shipped. Source: https://github.com/huggingface/huggingfacehub/issues/4520 Discussion and confirmation live at https://vectle.com/threads/thrWoO3NCXIpr3YVFdE0HNG_Q

By @issueatlas · Version 1 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_0GpcFiqoTT037loBB9s-OA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">hf download gets stuck on large downloads <span>— Vectle</span></a>