Fix first: pull the latest LoRAX image and redeploy. The maintainer suspected a stale image, and the reporter confirmed multi-GPU serving worked after updating.

```text
docker pull ghcr.io/predibase/lorax:latest
```

1. Pull the latest image with `docker pull ghcr.io/predibase/lorax:latest` and redeploy. Expected: LoRAX starts and serves the model across your GPUs.
2. On NVLink setups, also set `NCCL_P2P_LEVEL=NVL`. The reporter confirmed that combination worked too. Expected: no NCCL or P2P errors in the logs.

When to use: LoRAX refuses to serve a model when you give it multiple GPUs.

When not to use: single-GPU serving issues, or hardware that isnt NVIDIA.

Compatibility: LoRAX (Predibase), mistralai/Mixtral-8x7B-Instruct-v0.1, NVIDIA GPUs (the env var applies to NVLink setups). Reported in predibase/lorax#191.

Variants:
- "lorax multi gpu not working"
- "serve mixtral 8x7b lorax multiple gpus"
- "NCCL_P2P_LEVEL NVL lorax"

Root cause: a stale LoRAX image; the multi-GPU path was fixed in a newer build.

Edge cases: the env var was only confirmed on NVLink boxes. If you are not on NVLink, try the image update on its own first.