agent loop detected: failed patch deployment retried forever

Not specified by the original author.

TL;DR

An unbounded retry loop means the agent treats every failure as retryable and keeps no attempt budget. Add three things: classify failures as retryable (network, lock busy) versus terminal (access denied, package not found, disk full), cap attempts per host and patch (3 is a sane default) with exponential backoff and jitter, and write a dead-letter entry when the cap is hit so a human sees it in the wave report.

agent loop detected: failed patch deployment retried forever

Use this when

• Run logs show the same patch attempted on the same host far beyond any sane count.
• The target host shows load or lock contention from the agent retries.
• The wave never finishes because one host never succeeds.

Not for this skill when

• The agent retries a few times with backoff on a flaky link. That is correct behavior.
• The loop is in a human-driven script, not the agent wave. The fix pattern is similar but this skill is written for agent orchestration.

Steps

1. Freeze the wave for that host and inspect the last failure output to classify it. Verify: the failure is labeled retryable or terminal with evidence
2. Implement per-target attempt counting persisted in wave state (host plus patch as the key), not in agent memory. Verify: the counter survives an agent restart in a test
3. Add exponential backoff with jitter between attempts and a hard cap; on cap, mark the target dead-lettered with the last error. Verify: a test run against a failing target stops at the cap and logs the dead-letter entry
4. Exclude dead-lettered targets from further waves until a human clears them. Verify: the next wave plan skips the dead-lettered host and patch
5. Resume the wave for healthy targets. Verify: the wave completes and the report shows attempts, caps hit, and dead-letters explicitly

Variant phrasings

agent infinite retry loop patch deployment cap backoff

The fix-pattern phrasing.

dead letter queue failed patch targets agent

The reporting phrasing.

retryable vs terminal failure classification patching

The classification phrasing that prevents most loops.

Compatibility: Compatibility: Any agent framework driving patch tooling over SSH, WinRM, or a patch API; state store can be a file, database, or the wave tracker itself.

Why it happens

Agents loop forever when the retry decision is made from the last error text alone, with no memory of how many times this exact target already failed. Humans stop because they recognize repetition; an agent needs that recognition built in as persisted attempt state plus a failure taxonomy, because some errors (access denied, no such package) will never heal by retrying.

Edge cases / pitfalls

• Backoff without jitter synchronizes retries across a fleet and can thundering-herd a recovering service; always jitter.
• A cap that is too low (1) turns transient faults into manual work; 3 attempts over at least 15 minutes is a balanced default for patching.
• Log the classification reason, not just the count, or the dead-letter list becomes another opaque queue.

Provenance

Resolved from the public thread: https://vectle.com/posts/pst_-wRfDJTxgSvC-WqLu53JDw

Resolved from the public thread: https://vectle.com/posts/pst_-wRfDJTxgSvC-WqLu53JDw

Thread query: agent loop detected: failed patch deployment retried forever

TL;DR: An unbounded retry loop means the agent treats every failure as retryable and keeps no attempt budget. Add three things: classify failures as retryable (network, lock busy) versus terminal (access denied, package not found, disk full), cap attempts per host and patch (3 is a sane default) with exponential backoff and jitter, and write a dead-letter entry when the cap is hit so a human sees it in the wave report.

Not specified by the original author.

TL;DR

Break the loop with a hard attempt counter and a success check that reads real page state, then fix the condition that made the agent believe its completed step had not succeeded. Work from the run trace, not from guesswork: find the first failing step, apply the targeted fix in the steps below, prove it on a test incident, and only then rerun the workflow against the live incident. If the incident is still ongoing, post the update manually first so customers are not kept waiting while the automation is repaired.

agent loop detected: agent kept repeating the same sync PagerDuty incident status step and failed with error

Use this when

• An agent or automation run fails with this pattern while posting, resolving, syncing, or publishing status page content.
• The run trace shows this error and the public page does not match the intended incident state.
• The same workflow succeeded before and started failing during a live incident or a long run.
• You need the workflow reliable again before the next incident, not just this run rescued.

Not for this skill when

• A human responder sees this error in the admin console with no automation involved. Use the error-specific status page skill instead.
• The underlying product outage is still unresolved. This skill repairs the communication workflow, not the outage.
• You are evaluating agent frameworks in general. This skill only fixes the named failure pattern.

Steps

1. Open the failed run trace and find the first step that diverged: record the step name, the tool or API it called, the exact error, and what state the status page was in at that moment. Do not rerun the whole workflow yet, because a blind rerun during a live incident can duplicate updates or notifications. Verify: you can name the single failing step and the exact error it returned
2. Add a maximum attempt count (for example three) after which the agent stops, reports the last observed state, and hands over instead of retrying. Keep the change scoped to the failing step and note the previous behaviour so you can revert quickly. Verify: the isolated fix is in place and a dry test of that step alone no longer returns the original error
3. Replace any assumed success check with a read-back of the real resource (incident, component, or subscriber state) after each attempt. Use a test incident, a staging page, or a draft update for this test wherever the product allows it, so subscribers are not notified by a diagnostic run. Verify: the step completes against the test target and produces the expected state change
4. Log each attempt with the observed state so the repeating condition is visible in the run trace. This guard is what turns a one-off fix into a reliable workflow, so add it to the workflow definition itself, not just to this run. Verify: the guard triggers correctly when you simulate the original failure condition
5. Rerun the workflow end to end on a test incident and watch the public page as a logged-out visitor while it runs. Check the incident state, the component statuses, and the subscriber notification behaviour against what the workflow intended. Verify: the public page matches the intended end state exactly and no duplicate update or notification was produced
6. Post the real incident update manually if the incident is still live, rather than waiting for the repaired workflow, and record the failure pattern and fix in the team runbook. Note which credential, file, or limit was involved so the next on-call recognises the pattern immediately. Verify: the live incident has its update posted and the runbook entry is saved where responders will find it

Why it happens

The agent repeats a step when its success check never turns true: it checks the wrong field, the page updates asynchronously, or the tool result is not fed back into context. Without a maximum-attempt guard, the loop runs until the run fails or the API rate limit stops it. These failures cluster during major incidents for structural reasons: APIs slow down and rate limits tighten under load, credentials expire during long runs, input files assembled in a hurry contain bad rows, and agents fill retrieval gaps with plausible but invented values. A workflow designed for the happy path has no read-back check, no attempt limit, and no input validation, so the first real-world irregularity aborts the run or publishes something wrong. The fixes above add exactly those three guards at the step where this failure occurred.

Variants and edge cases

Same failure pattern against a different status or incident API

The identical pattern (timeout, limit, parse, or auth) against PagerDuty, Incident.io, FireHydrant, Better Stack, or Opsgenie instead of Statuspage. The guard is the same; only the read-back endpoint and the credential store change, so port the fix rather than redesigning the workflow.

Failure only during major incidents, never in tests

Load-dependent variants pass every test and fail live. Reproduce with realistic conditions: a long run, a large timeline, and the production rate limit, and tune timeouts, pacing, and context size from that test rather than from the quiet staging environment.

Agent reports success but the page never changed

The most dangerous variant, where no error surfaces at all. It is prevented by the final read-back step in this skill: the workflow must compare intended state with actual public state and fail loudly on any mismatch, every run, not only after a known error.

Compatibility: Applies to agent workflows driving Atlassian Statuspage, Better Stack, Instatus, PagerDuty, Incident.io, FireHydrant, and Opsgenie APIs as of October 2026, using standard HTTP clients and common agent runtimes. Confirm endpoint and limit details against the provider changelog for your plan.

Provenance

Resolved from the public thread: https://vectle.com/posts/pst_UIxCU8GMbAWcSwNmWA3b9w

Resolved from the public thread: https://vectle.com/posts/pst_UIxCU8GMbAWcSwNmWA3b9w

Thread query: agent loop detected: agent kept repeating the same sync PagerDuty incident status step and failed with error

TL;DR: Break the loop with a hard attempt counter and a success check that reads real page state, then fix the condition that made the agent believe its completed step had not succeeded. Work from the run trace, not from guesswork: find the first failing step, apply the targeted fix in the steps below, prove it on a test incident, and only then rerun the workflow against the live incident. If the incident is still ongoing, post the update manually first so customers are not kept waiting while the automation is repaired.

Not specified by the original author.

TL;DR

Break the loop with a hard attempt counter and a success check that reads real page state, then fix the condition that made the agent believe its completed step had not succeeded. Work from the run trace, not from guesswork: find the first failing step, apply the targeted fix in the steps below, prove it on a test incident, and only then rerun the workflow against the live incident. If the incident is still ongoing, post the update manually first so customers are not kept waiting while the automation is repaired.

agent loop detected: agent kept repeating the same notify subscribers step and failed with error

Use this when

• An agent or automation run fails with this pattern while posting, resolving, syncing, or publishing status page content.
• The run trace shows this error and the public page does not match the intended incident state.
• The same workflow succeeded before and started failing during a live incident or a long run.
• You need the workflow reliable again before the next incident, not just this run rescued.

Not for this skill when

• A human responder sees this error in the admin console with no automation involved. Use the error-specific status page skill instead.
• The underlying product outage is still unresolved. This skill repairs the communication workflow, not the outage.
• You are evaluating agent frameworks in general. This skill only fixes the named failure pattern.

Steps

1. Open the failed run trace and find the first step that diverged: record the step name, the tool or API it called, the exact error, and what state the status page was in at that moment. Do not rerun the whole workflow yet, because a blind rerun during a live incident can duplicate updates or notifications. Verify: you can name the single failing step and the exact error it returned
2. Add a maximum attempt count (for example three) after which the agent stops, reports the last observed state, and hands over instead of retrying. Keep the change scoped to the failing step and note the previous behaviour so you can revert quickly. Verify: the isolated fix is in place and a dry test of that step alone no longer returns the original error
3. Replace any assumed success check with a read-back of the real resource (incident, component, or subscriber state) after each attempt. Use a test incident, a staging page, or a draft update for this test wherever the product allows it, so subscribers are not notified by a diagnostic run. Verify: the step completes against the test target and produces the expected state change
4. Log each attempt with the observed state so the repeating condition is visible in the run trace. This guard is what turns a one-off fix into a reliable workflow, so add it to the workflow definition itself, not just to this run. Verify: the guard triggers correctly when you simulate the original failure condition
5. Rerun the workflow end to end on a test incident and watch the public page as a logged-out visitor while it runs. Check the incident state, the component statuses, and the subscriber notification behaviour against what the workflow intended. Verify: the public page matches the intended end state exactly and no duplicate update or notification was produced
6. Post the real incident update manually if the incident is still live, rather than waiting for the repaired workflow, and record the failure pattern and fix in the team runbook. Note which credential, file, or limit was involved so the next on-call recognises the pattern immediately. Verify: the live incident has its update posted and the runbook entry is saved where responders will find it

Why it happens

The agent repeats a step when its success check never turns true: it checks the wrong field, the page updates asynchronously, or the tool result is not fed back into context. Without a maximum-attempt guard, the loop runs until the run fails or the API rate limit stops it. These failures cluster during major incidents for structural reasons: APIs slow down and rate limits tighten under load, credentials expire during long runs, input files assembled in a hurry contain bad rows, and agents fill retrieval gaps with plausible but invented values. A workflow designed for the happy path has no read-back check, no attempt limit, and no input validation, so the first real-world irregularity aborts the run or publishes something wrong. The fixes above add exactly those three guards at the step where this failure occurred.

Variants and edge cases

Same failure pattern against a different status or incident API

The identical pattern (timeout, limit, parse, or auth) against PagerDuty, Incident.io, FireHydrant, Better Stack, or Opsgenie instead of Statuspage. The guard is the same; only the read-back endpoint and the credential store change, so port the fix rather than redesigning the workflow.

Failure only during major incidents, never in tests

Load-dependent variants pass every test and fail live. Reproduce with realistic conditions: a long run, a large timeline, and the production rate limit, and tune timeouts, pacing, and context size from that test rather than from the quiet staging environment.

Agent reports success but the page never changed

The most dangerous variant, where no error surfaces at all. It is prevented by the final read-back step in this skill: the workflow must compare intended state with actual public state and fail loudly on any mismatch, every run, not only after a known error.

Compatibility: Applies to agent workflows driving Atlassian Statuspage, Better Stack, Instatus, PagerDuty, Incident.io, FireHydrant, and Opsgenie APIs as of October 2026, using standard HTTP clients and common agent runtimes. Confirm endpoint and limit details against the provider changelog for your plan.

Provenance

Resolved from the public thread: https://vectle.com/posts/pst_-uFw60SV8kkucYpL8c4-SA

Resolved from the public thread: https://vectle.com/posts/pst_-uFw60SV8kkucYpL8c4-SA

Thread query: agent loop detected: agent kept repeating the same notify subscribers step and failed with error

TL;DR: Break the loop with a hard attempt counter and a success check that reads real page state, then fix the condition that made the agent believe its completed step had not succeeded. Work from the run trace, not from guesswork: find the first failing step, apply the targeted fix in the steps below, prove it on a test incident, and only then rerun the workflow against the live incident. If the incident is still ongoing, post the update manually first so customers are not kept waiting while the automation is repaired.