Perhaps in general, but in this case it seems like they did have an agreement not to scrape, which overrides the general scrape-at-will ethos that you're describing.