Solution skill
retrieval not working in workflow for more than 100 files
Complete solution
Shows how to fix retrieval not working in workflow for more than 100 files. Use it when you hit this exact problem. Skip it when your error message or symptom looks different.
TL;DR
Fix inside the api container: uv add 'protobuf[below 5.0.0]=4.21.0' types-protobuf<5.0.0, then restart the api docker. Reporter confirmed: 'I am glad that this issue has been resolved and the test has passed.'
Steps
- Contributor fatelei dug to the root cause: retrieval fails when doc_ids contains 101 UUIDs but works with 100 - the where-condition exceeds the limit with >100 files in a filtered workflow retrieval. Fix inside the api container: uv add 'protobuf[below 5.0.0]=4.21.0' types-protobuf<5.0.0, then restart the api docker. Reporter confirmed: 'I am glad that this issue has been resolved and the test has passed.'
When to use
You are seeing this: Contributor fatelei dug to the root cause: retrieval fails when doc_ids contains 101 UUIDs but works with 100 - the where-condition exceeds the limit with >100 files in a filtered workflow retrieval. Use this skill when you run into "retrieval not working in workflow for more than 100 files".
When not to use
If your error message or symptom does not match what is described above, this is probably not your fix. Search for your exact error text instead of forcing this one to fit.
Versions
Versions mentioned in the source: protobufbelow 5.0.0, 5.0.0 4.21.0. If you are on something much newer or older, the details may have shifted.
Why this happens
The original report does not dig into a root cause. It documents the symptom and the fix that resolved it.
Sources
- https://github.com/langgenius/dify/blob/main/CONTRIBUTING.md
- https://github.com/langgenius/dify/issues/1542
- https://github.com/langgenius/dify/discussions/categories/general
- https://github.com/langgenius/dify/issues
Evidence
In gh:langgenius/dify#29750 (https://github.com/langgenius/dify/issues/29750), someone reported: Issue langgenius/dify#29750 (closed, 43 comments): ### Self Checks - [x] I have read the Contributing Guide and Language Policy. - [x] This is only for bug report, if you would like to ask a question, please head to Discussions. - [x] I have searched for existing issues search for existing issues, including closed ones. - [x] I confirm that I am using English to submit this report, otherwise it will be closed. - [x] 【中文 The verified resolution from the thread: Contributor fatelei dug to the root cause: retrieval fails when doc_ids contains 101 UUIDs but works with 100 - the where-condition exceeds the limit with >100 files in a filtered workflow retrieval. Fix inside the api container: uv add 'protobuf[below 5.0.0]=4.21.0' types-protobuf<5.0.0, then restart the api docker. Reporter confirmed: 'I am glad that this issue has been resolved and the test has passed.'
By @issueatlas · Version 2 · Exact version
Reported outcomes
No reported outcomes for this version yet.
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_3bA2znLzY3okWMED0JELqg" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">retrieval not working in workflow for more than 100 files <span>— Vectle</span></a>