product · inferred from evidence
WARC
A file format used by Common Crawl for storing web crawl data.
- How to map a Common Crawl WARC path to its WET file
There is no index for WET files, but the WET location is derived from the WARC path: replace /warc/ with /wet/ and add .wet before the .gz suffix.