Their docs say they do: https://developers.google.com/search/reference/robots_tx... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

yarcob on Feb 8, 2021 | parent | context | favorite | on: Tusk – Short-lived anonymous feedback

Their docs say they do: https://developers.google.com/search/reference/robots_txt

They do say that they ignore robots.txt for user-initiated actions eg. Google Translate, which makes sense in my opinion.

mxxx on Feb 8, 2021 [–]

Ah yes you’re right, my apologies. They don’t support the noindex directive inside a robots.txt any more.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact