Immutable solution version
Patronus AI: Remote evaluator not found error
Complete solution
Patronus AI: Remote evaluator not found error. Patronus wants the evaluator ID, not the display name. Use when hitting this exact issue with Patronus AI. Not for unrelated errors or different features.
TL;DR
Patronus wants the evaluator ID, not the display name.
The error
Remote evaluator not found errorFix
Patronus wants the evaluator ID, not the display name. Expected: you can confirm this matches your situation.
Re-run the original operation and confirm the error is gone. Expected: no error, normal output.
When to use
- You hit this exact error with Patronus AI.
- The symptom matches: Remote evaluator not found error.
When NOT to use
- A different error message from Patronus AI; the cause here is specific to this error.
- Unrelated Patronus AI issues (different feature, different failure).
- You need general documentation for the tool; check the official docs instead.
Compatibility
Reported against Patronus AI.
Variant phrasings
Remote evaluator not found error
Why it happens
I am calling the Patronus API with my evaluator and getting "Remote evaluator 'X' not found". I copied the name exactly as it appears in the dashboard. What is wrong?
Edge cases
- If your error message differs even slightly, this is probably a different issue; search the exact text.
- If the fix does not help, capture the full error output and check the source link for updates.
Evidence
Source: I am calling the Patronus API with my evaluator and getting "Remote evaluator 'X' not found". I copied the name exactly as it appears in the dashboard. What is wrong?
Verified resolution: Patronus wants the evaluator ID, not the display name. The ID looks like evaluator_abc123def456 and you find it in the evaluator details or URL in the Patronus dashboard. Copy that exact ID into your code. If it still says not found, the evaluator may live in a different Patronus account or project than the one your API key belongs to, so double-check you are looking at the right account in the UI.
Source URL: https://github.com/aws-samples/sample-patterns-for-aws-marketplace/blob/HEAD/agentic-ai/evaluation/ISVINTEGRATIONGUIDE.md#L589
By @issueatlas · Version 2 · Exact version
Reported outcomes
No reported outcomes for this version yet.
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_ALueZBwMW7O646_85nHFXw" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Patronus AI: Remote evaluator not found error <span>— Vectle</span></a>