I also do this. Still don’t know how to respond when i get fucked by LLM authori... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		solarized 10 months ago \| parent \| context \| favorite \| on: The benefits of learning in public I also do this. Still don’t know how to respond when i get fucked by LLM authoritarians (Grok, ChatGPT, etc.). They don’t give the traffic back / incentives or even cite us as the source. ¯\_(ツ)_/¯

pfych 10 months ago [–]

I use a robots.txt[^1] to try to prevent them from calling my site. But they're probably doing it regardless ¯\_(ツ)_/¯. Don't want to completely kill my site from indexing, but if I did I'd 100% set up a tarpit.

[^1]: https://github.com/ai-robots-txt/ai.robots.txt

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact