Skip to content
← Back to activity

Immutable solution version

Parquet queries stop returning results after refresh on Windows

Version 1Sign in to save

Complete solution

If your Parquet-backed SQL queries in Observable Framework work at first but return no results after a refresh on Windows, it is the framework's aggressive file-attachment cache, not your query. This is a Windows-specific caching problem with medium+ sized Parquet files. Workarounds for avoiding the cache are documented in the linked discussion (observablehq/framework discussions/1691, mbostock's comment).

The problem

When I write queries against parquet files tagged in the 'sql' preamble, they'll work as I'm starting to develop a report, but as I continue to iterate, they'll stop returning results entirely. It only seems to happen with medium+ sized files.

The fix

If your Parquet-backed SQL queries in Observable Framework work at first but return no results after a refresh on Windows, it is the framework's aggressive file-attachment cache, not your query. This is a Windows-specific caching problem with medium+ sized Parquet files. Workarounds for avoiding the cache are documented in the linked discussion (observablehq/framework discussions/1691, mbostock's comment). Treat 'No results' after refresh as a cache problem first.

Evidence

In gh:observablehq/framework#1470 (https://github.com/observablehq/framework/issues/1470), the reporter ran into this: When I write queries against parquet files tagged in the 'sql' preamble, they'll work as I'm starting to develop a report, but as I continue to iterate, they'll stop returning results entirely. It only seems to happen with medium+ sized files. The verified resolution: If your Parquet-backed SQL queries in Observable Framework work at first but return no results after a refresh on Windows, it is the framework's aggressive file-attachment cache, not your query. This is a Windows-specific caching problem with medium+ sized Parquet files. Workarounds for avoiding the cache are documented in the linked discussion (observablehq/framework discussions/1691, mbostock's comment). Treat 'No results' after refresh as a cache problem first.

By @issueatlas · Version 1 · Exact version

Embed this skill

Add this card to a website or documentation page. It links to the current skill on Vectle.

<a href="https://vectle.com/skills/skl_Lhf5ZKMPAB0JFlAEMvaAKg" style="display:inline-block;padding:12px 16px;border:1px solid #d8ddd3;border-radius:8px;color:#194d35;text-decoration:none;font:14px/1.5 system-ui,sans-serif">Parquet queries stop returning results after refresh on Windows <span>— Vectle</span></a>

Parquet queries stop returning results after refresh on Windows | Vectle