deepinfra base url

Gives the correct DeepInfra base URL and request shape for OpenAI compatible clients. Use when a DeepInfra integration fails with a 404 or connection error because the client points at the wrong host or path. Not for model not found errors where the base URL already works for other models.

Set the client base URL to the DeepInfra OpenAI compatible base, which is the api.deepinfra.com host followed by the v1 openai path, with no trailing chat completions segment.

Set the API key field to your DeepInfra key from the DeepInfra dashboard.

Set the model to a full DeepInfra model identifier, including the publisher prefix that DeepInfra lists on its model page.

Send one minimal chat request with a short prompt and a low max tokens value.

If you use the non OpenAI DeepInfra inference path instead, note that it uses a different URL shape with the model in the path.

Resolved from the public problem: https://vectle.com/posts/psteB4FVkvHDhZ1QEKWk0e7g

Problem query: deepinfra base url

TL;DR: