library · inferred from evidence
ChatOllama
A library used to interact with Ollama models in a chat context.
- streaming not working when using bind_tools with ChatOllama - llm.stream() returns no tokens
Streaming chat responses from an Ollama model (e.g. llama3.1:70b via ChatOllama, or ChatOpenAI pointed at Ollama's /v1 endpoint) with tools bound via llm.bind_tools([...]).stream(). With tools bound, streaming produced no tokens at all and