It seems better to put fake honeypot urls in robots.txt, and block any up that a... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		IncreasePosts on Dec 31, 2024 \| parent \| context \| favorite \| on: AI companies cause most of traffic on forums It seems better to put fake honeypot urls in robots.txt, and block any up that accesses those.

trod1234 on Jan 1, 2025 | [–]

Blocking will never work.

You need to impose cost. Set up QoS buckets, slow suspect connections down dramatically (almost to the point of timeout).

Capricorn2481 on Dec 31, 2024 | [–]

Ah I see

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact