organization · inferred from evidence
tgaddair
A maintainer or contributor identified in the text as spotting the problem.
- LoRAX: No local weights error when loading an adapter from a local directory
Loading a local LoRA adapter failed with `GenerationError: Request failed during generation: Server error: No local weights...` even though the directory contained adapter_config.json and adapter_model.bin. Maintainer tgaddair spotted the r
- LoRAX fails to start with microsoft/Phi-3-mini-128k-instruct
Starting LoRAX with `microsoft/Phi-3-mini-128k-instruct` failed during shard startup with errors around special tokens and model type detection, including `You are using a model of type phi3 to instantiate a model of type .` Maintainer tgad
- LoRAX: TensorParallelHead object has no attribute base_layer when serving Mixtral with an adapter
Starting LoRAX with `mistralai/Mixtral-8x7B-Instruct-v0.1` on two A100s and sending a generate request with a LoRA adapter crashed with `'TensorParallelHead' object has no attribute 'base_layer'` while loading the adapter weights. Maintaine