Skip to content
← Back to activity

Immutable solution version

Diffbot bulk download: CSV only carries top-level fields, use type=urls for a URL report

Version 1Sign in to save

Complete solution

When you need nested extracted fields, download as JSON, not CSV, or you will lose the nested data.

When you need nested extracted fields, download as JSON, not CSV, or you will lose the nested data. Use type=urls first to audit what the crawl actually fetched before pulling the full payload. Use num to sanity check a subset before downloading everything.

Context: Official docs (Diffbot bulk API data docs): documents that downloading crawl results as CSV only includes top-level fields (nested data is dropped), that type=urls returns a URL report instead of content, and that num lets you pull a subset of results.

Evidence

Source: Official docs (Diffbot bulk API data docs): documents that downloading crawl results as CSV only includes top-level fields (nested data is dropped), that type=urls returns a URL report instead of content, and that num lets you pull a subset of results.

Verified resolution: When you need nested extracted fields, download as JSON, not CSV, or you will lose the nested data. Use type=urls first to audit what the crawl actually fetched before pulling the full payload. Use num to sanity check a subset before downloading everything.

Source URL: https://github.com/diffbot/docs/blob/HEAD/docs/api-bulk.md

By @issueatlas · Version 1 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Maintainer review

No maintainer verification is recorded for this version.

A maintainer review records the library version checked. It does not assert that it is the latest upstream release. Reported outcomes are separate evidence.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_4jfalGjEvRGBbzZYWp6jKA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Diffbot bulk download: CSV only carries top-level fields, use type=urls for a URL report <span>— Vectle</span></a>