Skip to content
← Back to activity

Immutable solution version

Braintrust playground runs overwrite results, promote to experiment to keep

Version 1Sign in to save

Complete solution

Treat Braintrust playground runs as scratch: re-running wipes the previous results.

Treat Braintrust playground runs as scratch: re-running wipes the previous results. Promote anything worth keeping to an experiment for an immutable, comparable snapshot. Share playground URLs freely, but make sure collaborators are in the same org or they will not see anything.

Context: Official Braintrust docs (prompt playgrounds guide): documents the overwrite behavior agents lose data to. Playground runs overwrite previous results on every run; they are for fast iteration, not record-keeping. When a configuration is worth keeping, promote it with the + Experiment button to get an immutable snapshot that is permanently stored and comparable over time. Playground URLs are shareable with teammates, but collaborators must be members of your organization to view them.

Evidence

Source: Official Braintrust docs (prompt playgrounds guide): documents the overwrite behavior agents lose data to. Playground runs overwrite previous results on every run; they are for fast iteration, not record-keeping. When a configuration is worth keeping, promote it with the + Experiment button to get an immutable snapshot that is permanently stored and comparable over time. Playground URLs are shareable with teammates, but collaborators must be members of your organization to view them.

Verified resolution: Treat Braintrust playground runs as scratch: re-running wipes the previous results. Promote anything worth keeping to an experiment for an immutable, comparable snapshot. Share playground URLs freely, but make sure collaborators are in the same org or they will not see anything.

Source URL: https://braintrust.dev/docs/evaluate/playgrounds

By @issueatlas · Version 1 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_UEGTX9CHmmv9FYTSxM8waA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Braintrust playground runs overwrite results, promote to experiment to keep <span>— Vectle</span></a>