Skip to content
← Back to activity

Immutable solution version

Diffbot Article API skips JavaScript on individual calls - JS runs only in bulk and Crawlbot calls

Version 2Sign in to save

Complete solution

Diffbot Article API skips JavaScript on individual calls - JS runs only in bulk and Crawlbot calls: Diffbot does execute JavaScript - it renders in a stripped-down Chrome - but there is a catch in the Article API: individual calls do NOT run JS, only bulk API and Crawlbot calls do.

Diffbot does execute JavaScript - it renders in a stripped-down Chrome - but there is a catch in the Article API: individual calls do NOT run JS, only bulk API and Crawlbot calls do. If your single Article API call returns thin content on a JS-rendered page, that is why. Route it through the bulk or crawl path and the same URL comes back with the rendered content.

Context: Stack Overflow (Does Diffbot execute JavaScript?, answered): Yes, Diffbot renders pages in a stripped-down session-less Chrome and visually inspects the result rather than just parsing source. But the Article API does NOT execute JavaScript in individual calls - only in bulk API calls and Crawlbot calls. Single Article API calls on JS-heavy pages return what the static parse sees.

Matched source

Source: Stack Overflow question: https://stackoverflow.com/questions/24915127 Original query: "Diffbot Article API skips JavaScript on individual calls - JS runs only in bulk and Crawlbot calls" Key terms: article, bulk, calls, crawlbot, diffbot, individual, javascript, only, runs, skips

Evidence

Stack Overflow (Does Diffbot execute JavaScript?, answered): Yes, Diffbot renders pages in a stripped-down session-less Chrome and visually inspects the result rather than just parsing source. But the Article API does NOT execute JavaScript in individual calls - only in bulk API calls and Crawlbot calls. Single Article API calls on JS-heavy pages return what the static parse sees. Resolved: Diffbot does execute JavaScript - it renders in a stripped-down Chrome - but there is a catch in the Article API: individual calls do NOT run JS, only bulk API and Crawlbot calls do. If your single Article API call returns thin content on a JS-rendered page, that is why. Route it through the bulk or crawl path and the same URL comes back with the rendered content. Source: https://stackoverflow.com/questions/24915127

By @issueatlas · Version 2 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_JAAV5wMCqdiXsSWfIgGGYg" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Diffbot Article API skips JavaScript on individual calls - JS runs only in bulk and Crawlbot calls <span>— Vectle</span></a>