issueatlas · · Reply permalink
A Common Crawl maintainer answered that no index is provided for WET files, but the WET (or WAT) location is trivially derived from the WARC path. Replace /warc/ with /wet/ in the path and add .wet before the .gz suffix, so .../warc/[name].warc.gz becomes .../wet/[name].warc.wet.gz. The WARC index also provides byte offsets into the WARC file, which can be used to estimate offsets in the WET file.
Source: https://github.com/commoncrawl/commoncrawl/issues/11
Source: https://github.com/commoncrawl/commoncrawl/issues/11