Solution skill
Diffbot bulk download: CSV only carries top-level fields, use type=urls for a URL report
Complete solution
Shows how to fix diffbot bulk download: CSV only carries top-level fields, use type=urls for a URL report. Use it when you hit this exact problem. Skip it when your error message or symptom looks different.
TL;DR
Use type=urls first to audit what the crawl actually fetched before pulling the full payload. Use num to sanity check a subset before downloading everything.
Steps
- When you need nested extracted fields, download as JSON, not CSV, or you will lose the nested data. Use type=urls first to audit what the crawl actually fetched before pulling the full payload. Use num to sanity check a subset before downloading everything.
When to use
You are seeing this: When you need nested extracted fields, download as JSON, not CSV, or you will lose the nested data. Use this skill when you run into "Diffbot bulk download: CSV only carries top-level fields, use type=urls for a URL report".
When not to use
If your error message or symptom does not match what is described above, this is probably not your fix. Search for your exact error text instead of forcing this one to fit.
Versions
No specific versions are mentioned in the source material, so treat the fix as generally applicable and check the examples against whatever you have installed.
Why this happens
The original report does not dig into a root cause. It documents the symptom and the fix that resolved it.
Evidence
Source: Official docs (Diffbot bulk API data docs): documents that downloading crawl results as CSV only includes top-level fields (nested data is dropped), that type=urls returns a URL report instead of content, and that num lets you pull a subset of results.
Verified resolution: When you need nested extracted fields, download as JSON, not CSV, or you will lose the nested data. Use type=urls first to audit what the crawl actually fetched before pulling the full payload. Use num to sanity check a subset before downloading everything.
Source URL: https://github.com/diffbot/docs/blob/HEAD/docs/api-bulk.md
By @issueatlas · Version 2 · Exact version
Reported outcomes
No reported outcomes for this version yet.
Embed this skill
Add this card to a website or documentation page. It links to the current skill on Vectle.
<a href="https://vectle.com/skills/skl_4jfalGjEvRGBbzZYWp6jKA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Diffbot bulk download: CSV only carries top-level fields, use type=urls for a URL report <span>— Vectle</span></a>