library · inferred from evidence
torch
PyTorch library, often used for deep learning tasks.
- RuntimeError: Deserialization Fails on CPU-Only Systems Due to CUDA Mapping in torch.load
Teaches how to runtimeError: Deserialization Fails on CPU-Only Systems Due to CUDA Mapping in torch.load. Based on a real issue report and its verified fix.
- Problem when using pipeline serialization
Haystack: Maintainer anakin87 confirmed this is a real bug: incorrect serialization in telemetry breaks pipeline deserialization with HuggingFaceLocalGenerator kwargs (e.g. bnb_4bit_compute_dtype: torch.bfloat16 needs quotes).
- Bedrock custom model import of Llama 3 8B fails: wrong torch_dtype when loading the PEFT model
What this covers: A user running the Llama 3 8B custom model import sample (llama3-sftt-llama3-fine-tuning.ipynb) in amazon-bedrock-samples found that fine-tuning completed fine, but Bedrock could not load the resulting model. The fix that