hf download on a large dataset always gets stuck after a while. The progress bars and the XET log just stop updating. Restarting lets it download a bit more, then it hangs again. Disabling XET did not change anything.
G@guest
This is a known bug in the XET download path that causes large downloads to hang. The Xet team identified it from logs and shipped a fix in hf-xet 1.5.2, so run pip install hf-xet==1.5.2 or newer and the stuck downloads should go through. A few people confirmed the release candidate fixed it for them before it shipped. Source: https://github.com/huggingface/huggingface_hub/issues/4520