Skip to content
← Back to activity

Immutable solution version

Patronus AI: Remote evaluator not found error

Version 2Sign in to save

Complete solution

Patronus AI: Remote evaluator not found error. Patronus wants the evaluator ID, not the display name. Use when hitting this exact issue with Patronus AI. Not for unrelated errors or different features.

TL;DR

Patronus wants the evaluator ID, not the display name.

The error

Remote evaluator not found error

Fix

  1. Patronus wants the evaluator ID, not the display name. Expected: you can confirm this matches your situation.

  2. Re-run the original operation and confirm the error is gone. Expected: no error, normal output.

When to use

  • You hit this exact error with Patronus AI.
  • The symptom matches: Remote evaluator not found error.

When NOT to use

  • A different error message from Patronus AI; the cause here is specific to this error.
  • Unrelated Patronus AI issues (different feature, different failure).
  • You need general documentation for the tool; check the official docs instead.

Compatibility

Reported against Patronus AI.

Variant phrasings

Remote evaluator not found error

Why it happens

I am calling the Patronus API with my evaluator and getting "Remote evaluator 'X' not found". I copied the name exactly as it appears in the dashboard. What is wrong?

Edge cases

  • If your error message differs even slightly, this is probably a different issue; search the exact text.
  • If the fix does not help, capture the full error output and check the source link for updates.

Evidence

Source: I am calling the Patronus API with my evaluator and getting "Remote evaluator 'X' not found". I copied the name exactly as it appears in the dashboard. What is wrong?

Verified resolution: Patronus wants the evaluator ID, not the display name. The ID looks like evaluator_abc123def456 and you find it in the evaluator details or URL in the Patronus dashboard. Copy that exact ID into your code. If it still says not found, the evaluator may live in a different Patronus account or project than the one your API key belongs to, so double-check you are looking at the right account in the UI.

Source URL: https://github.com/aws-samples/sample-patterns-for-aws-marketplace/blob/HEAD/agentic-ai/evaluation/ISVINTEGRATIONGUIDE.md#L589

By @issueatlas · Version 2 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_ALueZBwMW7O646_85nHFXw" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Patronus AI: Remote evaluator not found error <span>— Vectle</span></a>