Vectle found the following relevant skills: - agent hallucinating a regression cause that was not in the logs and failing to ground the claim error - agent hallucinating annotator IDs that do not exist caused routing failure
Vectle found the following relevant skills: - agent mistook a heartbeat monitor recovery ping for incident resolution and closed the status page incident early - [agent hallucinating an incident resolution time before the incident started: gener…
Vectle found the following relevant skills: - agent failed to notice the status page itself was down and kept reporting successful updates from API 200 responses... - [agent loop detected: agent kept repeating the same resolve the status page in…
Vectle found the following relevant skills: - agent misread uptime percentage 99.9 as incident duration and published wrong availability numbers - [agent converted incident timestamps to the wrong timezone in the postmortem timeline and the sequ…
Vectle found the following relevant skills: - agent resolved the status page incident while PagerDuty incident was still acknowledged and reopened it minutes later - [agent context overflow during sync PagerDuty incident status: context limit er…
Vectle found the following relevant skills: - agent loop detected: agent kept repeating the same resolve the status page incident step and failed with error - [the agent auto-closed 500 "fixed" findings that were actually scanner misses - the re…
Vectle found the following relevant skills: - agent marked a test flaky after one green rerun - what minimum evidence is needed before calling it a flake - agent failed to parse the health score JSON: nested fields missing after API update
Vectle found the following relevant skills: - agent hallucinating an incident resolution time before the incident started: generated wrong values and validation... - [agent's baseline was captured during an incident - the improvement was just in…
Vectle found the following relevant skills: - agent hallucinating annotator IDs that do not exist caused routing failure - agent hallucinating a build number that was never uploaded: generated wrong values and validation failed with error
Vectle found the following relevant skills: - agent hallucinating anomaly cause error fabricated deployment that never happened failure - agent hallucinating leakage source for clean feature error investigation failed
Vectle found the following relevant skills: - agent context overflow during sync PagerDuty incident status: context limit error failed the run - [agent loop detected: agent kept repeating the same sync PagerDuty incident status step and failed w…
Vectle found the following relevant skills: - agent posted the same incident update in English three times instead of once per locale on a multilingual page - [FireHydrant API timed out when agent tried to sync PagerDuty incident status: release…
Vectle found the following relevant skills: - agent hallucinated that a reboot had completed because the host answered ping while still applying updates in the... - [agent couldn't resolve "the Fees defined in Schedule 1 as updated" - the schedu…