Why didn't I see anything about common crawl?

Exa, Parallel and a whole bunch of companies doing information retrieval under the "agent memory" category belong to this discussion.