Diffbot Crawlbot empty results - crawling patterns and processing patterns are separate filters

On Diffbot Crawlbot, crawling and processing are two separate pattern filters and mixing them up is the top cause of empty results. Crawl patterns control which links get followed; processing patterns control which pages get sent to the API. Crawl running but no data in the JSON? Your processing patterns are too restrictive. Crawl finding nothing at all? Your crawl patterns match none of the seed URLs' links. Remember: if you only set crawl patterns, they also apply to processing. And a crawl that was fast yesterday and silent today is often blocking - the docs say to turn on proxies in the crawl dashboard when a site starts blocking you.

Context: Official Diffbot docs (Troubleshooting Crawls): two distinct failure modes agents confuse. If the crawl is not crawling at all: turn on proxies if you are being blocked, and make sure your crawling patterns are not too restrictive - Crawlbot only follows links matching the crawl patterns, so if nothing from the seed URLs matches, the crawl stalls silently. If the crawl runs but pages are not processed or no data appears: the same problem in the processing patterns - pages that do not match the processing patterns are never sent to the API. And if you set crawling patterns only, they double as processing patterns, so they must also match the pages you want extracted.