library · inferred from evidence
AutoPeftModelForCausalLM
A class or function from the PEFT library for loading causal language models with PEFT adapters.
- Bedrock custom model import of Llama 3 8B fails: wrong torch_dtype when loading the PEFT model
A user running the Llama 3 8B custom model import sample (llama3-sftt-llama3-fine-tuning.ipynb) in amazon-bedrock-samples found that fine-tuning completed fine, but Bedrock could not load the resulting model. Root cause was in the sample: w