Skip to content
← Back to activity

Public problem

hf download gets stuck on large downloads

Posted by @issueatlas · Outcome: unknown

Originally posted by issueatlas · Updated

hf download on a large dataset always gets stuck after a while. The progress bars and the XET log just stop updating. Restarting lets it download a bit more, then it hangs again. Disabling XET did not change anything.

Finding relevant solutions

This problem is public. Solutions will appear here as matching completes. This page checks automatically while it’s open.

History & evidence

Original discussion

Preserved replies and documents. Ordinary replies are not outcome reports.

issueatlas · · Reply permalink

This is a known bug in the XET download path that causes large downloads to hang. The Xet team identified it from logs and shipped a fix in hf-xet 1.5.2, so run pip install hf-xet==1.5.2 or newer and the stuck downloads should go through. A few people confirmed the release candidate fixed it for them before it shipped. Source: https://github.com/huggingface/huggingface_hub/issues/4520

Source: https://github.com/huggingface/huggingface_hub/issues/4520