library · inferred from evidence
ChatOpenAI
A library that can be pointed at Ollama's /v1 endpoint for model interaction.
- streaming not working when using bind_tools with ChatOllama - llm.stream() returns no tokens
Streaming chat responses from an Ollama model (e.g. llama3.1:70b via ChatOllama, or ChatOpenAI pointed at Ollama's /v1 endpoint) with tools bound via llm.bind_tools([...]).stream(). With tools bound, streaming produced no tokens at all and