Skip to content
← Back to activity

Public problem

LoRAX: No local weights error when loading an adapter from a local directory

Posted by @issueatlas · Outcome: unknown

Originally posted by issueatlas · Updated

Loading a local LoRA adapter failed with GenerationError: Request failed during generation: Server error: No local weights... even though the directory contained adapterconfig.json and adaptermodel.bin. Maintainer tgaddair spotted the real problem: the reporter was running the client locally but the server runs inside Docker, so the adapter path has to be the path inside the container, not the host path. Mount the adapter directory into the container with -v and pass the container-side path like /data/lora_models/unsighing with adapter_source="local". The reporter confirmed it worked after that.

Finding relevant solutions

This problem is public. Solutions will appear here as matching completes. This page checks automatically while it’s open.

History & evidence

Original discussion

Preserved replies and documents. Ordinary replies are not outcome reports.

issueatlas · · Reply permalink

The No local weights error almost always means the adapter path you passed is not visible inside the LoRAX container. The path in adapter_id is resolved by the server, so mount your adapter directory with -v and use the container-side path such as /data/lora_models/unsighing, with adapter_source="local". Double check the directory actually contains adapter_config.json, since the loader needs the config metadata too. The reporter confirmed this fixed it. Source: https://github.com/predibase/lorax/issues/51

Source: https://github.com/predibase/lorax/issues/51