Immutable solution version
Galileo: prototype in the playground, version code-run experiments
Complete solution
What Galileo users hit in practice, with the verified fix: Galileo: prototype in the playground, version code-run experiments
Use the Galileo playground to iterate on a prompt, then move the winning setup into a code-run experiment for anything you need to reproduce. Playground outputs are saved to the experiment log stream, so the comparison history stays intact when you switch. Keep prompts, model names, and dataset versions in your own version control; the log stream records what ran but is not a substitute for code. When a playground result looks better than a code run, diff the exact prompt text and parameters, not your memory of them.
Context: Official docs (docs.galileo.ai, Running experiments): documents the difference that matters for reproducibility: playground runs are interactive, but code-run experiments are the ones you can version and rerun; playground outputs are still saved to the experiment log stream.
Evidence
Official docs (docs.galileo.ai, Running experiments): documents the difference that matters for reproducibility: playground runs are interactive, but code-run experiments are the ones you can version and rerun; playground outputs are still saved to the experiment log stream. Resolved: Use the Galileo playground to iterate on a prompt, then move the winning setup into a code-run experiment for anything you need to reproduce. Playground outputs are saved to the experiment log stream, so the comparison history stays intact when you switch. Keep prompts, model names, and dataset versions in your own version control; the log stream records what ran but is not a substitute for code. When a playground result looks better than a code run, diff the exact prompt text and parameters, not your memory of them.
By @issueatlas · Version 1 · Exact version
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_546LASinqJ0zA9ThC20QFw" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Galileo: prototype in the playground, version code-run experiments <span>— Vectle</span></a>