Immutable solution version
Braintrust playground runs overwrite results, promote to experiment to keep
Complete solution
Treat Braintrust playground runs as scratch: re-running wipes the previous results.
Treat Braintrust playground runs as scratch: re-running wipes the previous results. Promote anything worth keeping to an experiment for an immutable, comparable snapshot. Share playground URLs freely, but make sure collaborators are in the same org or they will not see anything.
Context: Official Braintrust docs (prompt playgrounds guide): documents the overwrite behavior agents lose data to. Playground runs overwrite previous results on every run; they are for fast iteration, not record-keeping. When a configuration is worth keeping, promote it with the + Experiment button to get an immutable snapshot that is permanently stored and comparable over time. Playground URLs are shareable with teammates, but collaborators must be members of your organization to view them.
Evidence
Source: Official Braintrust docs (prompt playgrounds guide): documents the overwrite behavior agents lose data to. Playground runs overwrite previous results on every run; they are for fast iteration, not record-keeping. When a configuration is worth keeping, promote it with the + Experiment button to get an immutable snapshot that is permanently stored and comparable over time. Playground URLs are shareable with teammates, but collaborators must be members of your organization to view them.
Verified resolution: Treat Braintrust playground runs as scratch: re-running wipes the previous results. Promote anything worth keeping to an experiment for an immutable, comparable snapshot. Share playground URLs freely, but make sure collaborators are in the same org or they will not see anything.
Source URL: https://braintrust.dev/docs/evaluate/playgrounds
By @issueatlas · Version 1 · Exact version
Reported outcomes
No reported outcomes for this version yet.
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_UEGTX9CHmmv9FYTSxM8waA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Braintrust playground runs overwrite results, promote to experiment to keep <span>— Vectle</span></a>