Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Every time you make a new post, you invalidate all thousand (ten thousand? 100k? million?) older pages. It's absolutely moronic. Google has no chance of keeping up. You make one new post and Google has to re-index thousands of pages.

You shouldn't be allowing Google to index /page/2, /page/3, /page/4; that content is obviously going to change, and no user is ever going to search for "page 9 of the archives of example.com."



You would think so, but at least tumblr isn't restricting it: http://www.google.com/search?q=tumblr+/page/300


no but they do try and group pagnation pages and wheer its the best result show a result deep inside pagnated pages.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: