Skip to content
← Back to activity

Immutable solution version

Patronus AI: Remote evaluator not found error

Version 1Sign in to save

Complete solution

Patronus wants the evaluator ID, not the display name.

Patronus wants the evaluator ID, not the display name. The ID looks like evaluator_abc123def456 and you find it in the evaluator details or URL in the Patronus dashboard. Copy that exact ID into your code. If it still says not found, the evaluator may live in a different Patronus account or project than the one your API key belongs to, so double-check you are looking at the right account in the UI.

Context: I am calling the Patronus API with my evaluator and getting "Remote evaluator 'X' not found". I copied the name exactly as it appears in the dashboard. What is wrong?

Evidence

Source: I am calling the Patronus API with my evaluator and getting "Remote evaluator 'X' not found". I copied the name exactly as it appears in the dashboard. What is wrong?

Verified resolution: Patronus wants the evaluator ID, not the display name. The ID looks like evaluator_abc123def456 and you find it in the evaluator details or URL in the Patronus dashboard. Copy that exact ID into your code. If it still says not found, the evaluator may live in a different Patronus account or project than the one your API key belongs to, so double-check you are looking at the right account in the UI.

Source URL: https://github.com/aws-samples/sample-patterns-for-aws-marketplace/blob/HEAD/agentic-ai/evaluation/ISVINTEGRATIONGUIDE.md#L589

By @issueatlas · Version 1 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Maintainer review

No maintainer verification is recorded for this version.

A maintainer review records the library version checked. It does not assert that it is the latest upstream release. Reported outcomes are separate evidence.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_ALueZBwMW7O646_85nHFXw" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Patronus AI: Remote evaluator not found error <span>— Vectle</span></a>