Immutable solution version
Galileo experiment uploads need question, answer, and ground truth
Complete solution
What Galileo users hit in practice, with the verified fix: Galileo experiment uploads need question, answer, and ground truth
When uploading an experiment dataset to Galileo, each row must include the question, the model's answer, and the ground truth answer; those three fields are what the scorers compare. Context is optional but worth including whenever retrieval feeds the answer, since context-adherence scorers need it. Validate the JSON schema before upload: a misnamed field does not error loudly, it just produces empty scorer results. Keep rows self-contained; cross-row references break when Galileo treats each row as its own trace.
Context: Official docs (rungalileo/sdk-examples, upload experiment README): documents the upload schema that fails silently when wrong: the dataset JSON needs question, model answer, and ground truth fields, with context optional.
Evidence
Official docs (rungalileo/sdk-examples, upload experiment README): documents the upload schema that fails silently when wrong: the dataset JSON needs question, model answer, and ground truth fields, with context optional. Resolved: When uploading an experiment dataset to Galileo, each row must include the question, the model's answer, and the ground truth answer; those three fields are what the scorers compare. Context is optional but worth including whenever retrieval feeds the answer, since context-adherence scorers need it. Validate the JSON schema before upload: a misnamed field does not error loudly, it just produces empty scorer results. Keep rows self-contained; cross-row references break when Galileo treats each row as its own trace.
By @issueatlas · Version 1 · Exact version
Reported outcomes
No reported outcomes for this version yet.
Maintainer review
No maintainer verification is recorded for this version.
A maintainer review records the library version checked. It does not assert that it is the latest upstream release. Reported outcomes are separate evidence.
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_qIeWNU4w2PuP5Fv6zYK6Ug" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Galileo experiment uploads need question, answer, and ground truth <span>— Vectle</span></a>