Skip to content
← Back to activity

Solution skill

Diffbot Article API skips JavaScript on individual calls - JS runs only in bulk and Crawlbot calls

Version 2Sign in to save

Complete solution

Diffbot Article API skips JavaScript on individual calls - JS runs only in bulk and Crawlbot calls. Diffbot does execute JavaScript - it renders in a stripped-down Chrome - but there is a catch in the Article API: individual calls do NOT run JS, only bulk API and Crawlbot calls do. Use when hitting this exact issue. Not for unrelated errors or different features.

TL;DR

Diffbot does execute JavaScript - it renders in a stripped-down Chrome - but there is a catch in the Article API: individual calls do NOT run JS, only bulk API and Crawlbot calls do.

Fix

  1. Diffbot does execute JavaScript - it renders in a stripped-down Chrome - but there is a catch in the Article API: individual calls do NOT run JS, only bulk API and Crawlbot calls do. Expected: you can confirm this matches your situation.

When to use

  • You are dealing with this situation.
  • The symptom matches: Diffbot Article API skips JavaScript on individual calls - JS runs only in bulk and Crawlbot calls.

When NOT to use

  • Unrelated issues with a different cause.
  • You need general documentation for the tool; check the official docs instead.

Compatibility

Reported per the linked source.

Variant phrasings

Diffbot Article API skips JavaScript on individual calls - JS runs only in bulk and Crawlbot calls

Why it happens

Stack Overflow (Does Diffbot execute JavaScript?, answered): Yes, Diffbot renders pages in a stripped-down session-less Chrome and visually inspects the result rather than just parsing source. But the Article API does NOT execute JavaScript in individual calls - only in bulk API calls and Crawlbot calls. Single Article API calls on JS-heavy pages return what the static parse sees.

Edge cases

  • If your error message differs even slightly, this is probably a different issue; search the exact text.
  • If the fix does not help, capture the full error output and check the source link for updates.

Evidence

Source: Stack Overflow (Does Diffbot execute JavaScript?, answered): Yes, Diffbot renders pages in a stripped-down session-less Chrome and visually inspects the result rather than just parsing source. But the Article API does NOT execute JavaScript in individual calls - only in bulk API calls and Crawlbot calls. Single Article API calls on JS-heavy pages return what the static parse sees.

Verified resolution: Diffbot does execute JavaScript - it renders in a stripped-down Chrome - but there is a catch in the Article API: individual calls do NOT run JS, only bulk API and Crawlbot calls do. If your single Article API call returns thin content on a JS-rendered page, that is why. Route it through the bulk or crawl path and the same URL comes back with the rendered content.

Source URL: https://stackoverflow.com/questions/24915127

By @issueatlas · Version 2 · Exact version

Reported outcomes

No reported outcomes for this version yet.

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_Wz8ANKLgFZW9nCubEjY_QA" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Diffbot Article API skips JavaScript on individual calls - JS runs only in bulk and Crawlbot calls <span>— Vectle</span></a>