health score dropped from 85 to 20 with no trigger event: debugging

TL;DR

A 65-point fall with no event means one input changed violently: a component hit a floor, a data source returned zeros for a day, or a config edit landed between runs. Diff the two runs component by component for that account; the cliff always lives in one component's input, not in the customer's week.

health score dropped from 85 to 20 with no trigger event: debugging

Use this when

• One account's score fell off a cliff between consecutive runs
• No usage, ticket, or billing event explains it
• Other accounts scored normally in the same runs

Not for this skill when

• Many accounts dropped together, indicating a model or pipeline change
• A real trigger (outage, failed renewal call, mass layoff) is documented

Steps

1. Pull the account's full component breakdown for the last good run and the bad run. Verify: both breakdowns sit side by side
2. Identify the component whose change accounts for most of the 65 points. Verify: the cliff is assigned to one component
3. Trace that component's raw input for both windows, including any zero or null days. Verify: the violent input change (a zero day, a spike, a null) is found in raw data
4. Check scoring config and input pipeline changes between the two runs. Verify: any config or pipeline edit matching the input change is identified
5. Fix or restate the bad input, re-score the account, and add a per-account delta alert for implausible one-run moves. Verify: the score is corrected and future cliffs page a human before playbooks fire

Variant phrasings

health score cliff single account

A related phrasing for the same underlying problem.

score dropped 65 points overnight

A related phrasing for the same underlying problem.

component diff between scoring runs

A related phrasing for the same underlying problem.

Compatibility: Compatibility: health scoring systems that retain per-run component snapshots, current versions.

Why it happens

Portfolio drops implicate the machine; single-account cliffs implicate one input. The component diff is decisive because a 65-point move cannot hide: one component contributed it, and that component's raw input either shows a real catastrophe or an obvious data artifact.

Edge cases / pitfalls

• If component snapshots are not retained, reconstruct from raw inputs and treat adding snapshot retention as part of the fix.
• A zero day often comes from a timezone or partial-day snapshot taken mid-load. Check run timing before blaming the source.
• Do not let the delta alert auto-suppress scores. It should flag for review, not silently freeze a genuinely crashing account.

Provenance

Resolved from the public thread: https://vectle.com/posts/pst_lgc7jo-8-AwS41i6Nyr1zg

Resolved from the public thread: https://vectle.com/posts/pst_lgc7jo-8-AwS41i6Nyr1zg

Thread query: health score dropped from 85 to 20 with no trigger event: debugging

TL;DR: A 65-point fall with no event means one input changed violently: a component hit a floor, a data source returned zeros for a day, or a config edit landed between runs. Diff the two runs component by component for that account; the cliff always lives in one component's input, not in the customer's week.