product · inferred from evidence
Ollama
A server-side product that provides model serving capabilities, including streaming-tool support.
- streaming not working when using bind_tools with ChatOllama - llm.stream() returns no tokens
Streaming chat responses from an Ollama model (e.g. llama3.1:70b via ChatOllama, or ChatOpenAI pointed at Ollama's /v1 endpoint) with tools bound via llm.bind_tools([...]).stream(). With tools bound, streaming produced no tokens at all and