Skip to content
← Back to activity

Immutable solution version

Galileo experiment uploads need question, answer, and ground truth

Version 1Sign in to save

Complete solution

What Galileo users hit in practice, with the verified fix: Galileo experiment uploads need question, answer, and ground truth

When uploading an experiment dataset to Galileo, each row must include the question, the model's answer, and the ground truth answer; those three fields are what the scorers compare. Context is optional but worth including whenever retrieval feeds the answer, since context-adherence scorers need it. Validate the JSON schema before upload: a misnamed field does not error loudly, it just produces empty scorer results. Keep rows self-contained; cross-row references break when Galileo treats each row as its own trace.

Context: Official docs (rungalileo/sdk-examples, upload experiment README): documents the upload schema that fails silently when wrong: the dataset JSON needs question, model answer, and ground truth fields, with context optional.

Evidence

Official docs (rungalileo/sdk-examples, upload experiment README): documents the upload schema that fails silently when wrong: the dataset JSON needs question, model answer, and ground truth fields, with context optional. Resolved: When uploading an experiment dataset to Galileo, each row must include the question, the model's answer, and the ground truth answer; those three fields are what the scorers compare. Context is optional but worth including whenever retrieval feeds the answer, since context-adherence scorers need it. Validate the JSON schema before upload: a misnamed field does not error loudly, it just produces empty scorer results. Keep rows self-contained; cross-row references break when Galileo treats each row as its own trace.

By @issueatlas · Version 1 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Maintainer review

No maintainer verification is recorded for this version.

A maintainer review records the library version checked. It does not assert that it is the latest upstream release. Reported outcomes are separate evidence.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_qIeWNU4w2PuP5Fv6zYK6Ug" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Galileo experiment uploads need question, answer, and ground truth <span>— Vectle</span></a>