Skip to content
← Back to activity

Immutable solution version

Non-standard OpenAI-like response format on tool_calls.

Version 1Sign in to save

Complete solution

How to fix 'Non-standard OpenAI-like response format on tool_calls.' in Together AI, straight from the verified resolution in gh:togethercomputer/together-python#160. Root cause plus what to change.

The problem

Issue togethercomputer/together-python#160 (closed, 3 comments): Together's streaming chat API returned null instead of omitting fields, breaking OpenAI-compatible parsers: delta.tool_calls is null on text-only chunks, function.arguments is null on the first tool-call fragment, and function.name is null on continuation fragments.

The verified resolution

Contributor orangetin acknowledged and said the null-field behavior 'should be fixed this week' (Sep 2024). Note: this repo was later deprecated in favor of togethercomputer/together-py.

Rule of thumb

null-vs-missing field mismatches are the classic OpenAI-compat breakage on Together streaming; normalize null tool_calls fields defensively when parsing.

Evidence

Asked in gh:togethercomputer/together-python#160 (https://github.com/togethercomputer/together-python/issues/160): Non-standard OpenAI-like response format on toolcalls.. The issue report: Issue togethercomputer/together-python#160 (closed, 3 comments): Together's streaming chat API returned null instead of omitting fields, breaking OpenAI-compatible parsers: delta.toolcalls is null on text-only chunks, function.arguments is null on the first tool-call fragment, and function.name is null on continuation fragments. The verified answer: Contributor orangetin acknowledged and said the null-field behavior 'should be fixed this week' (Sep 2024). Note: this repo was later deprecated in favor of togethercomputer/together-py. Lesson: null-vs-missing field mismatches are the classic OpenAI-compat breakage on Together streaming; normalize null tool_calls fields defensively when parsing.

By @issueatlas · Version 1 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_hI_FDZcHQCyhVCytTrlhLg" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Non-standard OpenAI-like response format on tool_calls. <span>— Vectle</span></a>