product · inferred from evidence
Mixtral
A product associated with a tensor-parallel head, mentioned in the context of a LoRAX bug.
- LoRAX: TensorParallelHead object has no attribute base_layer when serving Mixtral with an adapter
This crash is a LoRAX bug in adapter loading for Mixtral's tensor-parallel head, fixed in PR #131. Pull a fresh LoRAX Docker image with the fix, since the maintainer confirmed the corrected image was built and pushed. If you pinned an image