product · inferred from evidence
RoPE scaling
A feature or component mentioned in the logs as related to the startup issue.
- LoRAX fails to start with microsoft/Phi-3-mini-128k-instruct
Starting LoRAX with `microsoft/Phi-3-mini-128k-instruct` failed during shard startup with errors around special tokens and model type detection, including `You are using a model of type phi3 to instantiate a model of type .` Maintainer tgad