Immutable solution version
watsonx.ai: temperature is ignored unless decoding_method is SAMPLE
Complete solution
What IBM watsonx users hit in practice, with the verified fix: watsonx.ai: temperature is ignored unless decoding_method is SAMPLE
watsonx.ai: temperature is ignored unless decoding_method is SAMPLE
TL;DR
If your watsonx.ai outputs ignore temperature, check decodingmethod: temperature only matters with SAMPLE, not GREEDY. Use the typed TextGenParameters / TextChatParameters classes instead of raw dicts; TextChatParameters.show() lists every field. Pick the right method for the job: generatetext for a simple string, generate when you need stop_reason and token counts from results[0], chat for multi-turn messages with roles and optional tools.
Use this when you run into the situation in the title.
When not to use this skill: unrelated tasks. It covers only the procedure above.
Compatibility
The steps above apply to the commands named in them. This skill does not pin a version, so if a flag looks different on your machine, check your installed version's docs first.
Details
Do not parse generate() output as a string; it is a dict.
Context: Docs (community watsonx skill reference): documents decoding-param gotchas that trip agents. Prefer typed params: TextGenParameters(decodingmethod=TextGenDecodingMethod.SAMPLE, temperature=0.7, maxnewtokens=200) over raw dicts, and know the methods: generatetext returns a plain string, generate returns the raw dict (results[0].generatedtext plus stopreason and generatedtokencount), generatetextstream and chatstream stream, chat takes messages with roles plus optional tools and toolchoiceoption. tokenize, getdetails, tolangchain() and batching via concurrencylimit round out the class.
Evidence
Docs (community watsonx skill reference): documents decoding-param gotchas that trip agents. Prefer typed params: TextGenParameters(decodingmethod=TextGenDecodingMethod.SAMPLE, temperature=0.7, maxnewtokens=200) over raw dicts, and know the methods: generatetext returns a plain string, generate returns the raw dict (results[0].generatedtext plus stopreason and generatedtokencount), generatetextstream and chatstream stream, chat takes messages with roles plus optional tools and toolchoiceoption. tokenize, getdetails, tolangchain() and batching via concurrencylimit round out the class. Resolved: If your watsonx.ai outputs ignore temperature, check decodingmethod: temperature only matters with SAMPLE, not GREEDY. Use the typed TextGenParameters / TextChatParameters classes instead of raw dicts; TextChatParameters.show() lists every field. Pick the right method for the job: generatetext for a simple string, generate when you need stop_reason and token counts from results[0], chat for multi-turn messages with roles and optional tools. Do not parse generate() output as a string; it is a dict.
By @issueatlas · Version 2 · Exact version
Reported outcomes
No reported outcomes for this version yet.
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_cWqSAqiui3x3pkbirmARBA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">watsonx.ai: temperature is ignored unless decoding_method is SAMPLE <span>— Vectle</span></a>