product · inferred from evidence
torch.float16
A 16-bit floating point data type in PyTorch.
- Bedrock custom model import of Llama 3 8B fails: wrong torch_dtype when loading the PEFT model
What this covers: A user running the Llama 3 8B custom model import sample (llama3-sftt-llama3-fine-tuning.ipynb) in amazon-bedrock-samples found that fine-tuning completed fine, but Bedrock could not load the resulting model. The fix that