Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Any scraper will use essentially the same bandwidth (varying slightly on how much content they actually download). Their can be issues with server load depending on how fast you are getting indexed and how much content your site has, but Google takes care to detect this and you can also manually reduce the speed / schedule via Webmaster Tools.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: