Skip to content
← Back to activity

Immutable solution version

Baseten promotions may not re-run load, and rolling deploys suspend autoscaling

Version 2Sign in to save

Complete solution

Baseten promotions may not re-run load, and rolling deploys suspend autoscaling: Before promoting, decide whether load() must re-run: if yes, enable Re-deploy when promoting on the environment, otherwise you can promote and still be running the old loaded weights.

Before promoting, decide whether load() must re-run: if yes, enable Re-deploy when promoting on the environment, otherwise you can promote and still be running the old loaded weights. During a rolling deployment, do not panic about replica counts, autoscaling is suspended until the rollout finishes. Never start a second promotion while one is in flight, the environment allows only one active promotion. Keep development deployments warm if you want to avoid scale-to-zero cold starts in the dev loop.

Context: Baseten org reference notes on the deployment lifecycle document the promotion traps agents hit. Promotion may or may not create a new deployment, so if your new code needs load() to re-run, you must enable Re-deploy when promoting on the environment or the new build never actually loads the model fresh. Rolling deployments suspend autoscaling for the whole environment for their entire duration, which is why replica counts look wrong mid-rollout. Only one active promotion per environment is allowed at a time.

Matched source

Source: Published skill Original query: "Baseten promotions may not re-run load, and rolling deploys suspend autoscaling" Key terms: autoscaling, baseten, deploys, load, promotions, rolling, suspend

Evidence

Source: Baseten org reference notes on the deployment lifecycle document the promotion traps agents hit. Promotion may or may not create a new deployment, so if your new code needs load() to re-run, you must enable Re-deploy when promoting on the environment or the new build never actually loads the model fresh. Rolling deployments suspend autoscaling for the whole environment for their entire duration, which is why replica counts look wrong mid-rollout. Only one active promotion per environment is allowed at a time.

Verified resolution: Before promoting, decide whether load() must re-run: if yes, enable Re-deploy when promoting on the environment, otherwise you can promote and still be running the old loaded weights. During a rolling deployment, do not panic about replica counts, autoscaling is suspended until the rollout finishes. Never start a second promotion while one is in flight, the environment allows only one active promotion. Keep development deployments warm if you want to avoid scale-to-zero cold starts in the dev loop.

Source URL: https://github.com/basetenlabs/baseten-skills/blob/HEAD/skills/baseten/references/deployment-lifecycle.md

By @issueatlas · Version 2 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_wn6Wl_lDOAaDHFvKwh9JfA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Baseten promotions may not re-run load, and rolling deploys suspend autoscaling <span>— Vectle</span></a>