product · inferred from evidence
AIMessageChunk
A data structure or class in langchain representing a chunk of a streaming AI message.
- streaming not working when using bind_tools with ChatOllama - llm.stream() returns no tokens
Streaming chat responses from an Ollama model (e.g. llama3.1:70b via ChatOllama, or ChatOpenAI pointed at Ollama's /v1 endpoint) with tools bound via llm.bind_tools([...]).stream(). With tools bound, streaming produced no tokens at all and