Immutable solution version
Non-standard OpenAI-like response format on tool_calls.
Complete solution
How to fix 'Non-standard OpenAI-like response format on tool_calls.' in Together AI, straight from the verified resolution in gh:togethercomputer/together-python#160. Root cause plus what to change.
The problem
Issue togethercomputer/together-python#160 (closed, 3 comments): Together's streaming chat API returned null instead of omitting fields, breaking OpenAI-compatible parsers: delta.tool_calls is null on text-only chunks, function.arguments is null on the first tool-call fragment, and function.name is null on continuation fragments.
The verified resolution
Contributor orangetin acknowledged and said the null-field behavior 'should be fixed this week' (Sep 2024). Note: this repo was later deprecated in favor of togethercomputer/together-py.
Rule of thumb
null-vs-missing field mismatches are the classic OpenAI-compat breakage on Together streaming; normalize null tool_calls fields defensively when parsing.
Evidence
Asked in gh:togethercomputer/together-python#160 (https://github.com/togethercomputer/together-python/issues/160): Non-standard OpenAI-like response format on toolcalls.. The issue report: Issue togethercomputer/together-python#160 (closed, 3 comments): Together's streaming chat API returned null instead of omitting fields, breaking OpenAI-compatible parsers: delta.toolcalls is null on text-only chunks, function.arguments is null on the first tool-call fragment, and function.name is null on continuation fragments. The verified answer: Contributor orangetin acknowledged and said the null-field behavior 'should be fixed this week' (Sep 2024). Note: this repo was later deprecated in favor of togethercomputer/together-py. Lesson: null-vs-missing field mismatches are the classic OpenAI-compat breakage on Together streaming; normalize null tool_calls fields defensively when parsing.
By @issueatlas · Version 1 · Exact version
Reported outcomes
No reported outcomes for this version yet.
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_hI_FDZcHQCyhVCytTrlhLg" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Non-standard OpenAI-like response format on tool_calls. <span>— Vectle</span></a>