Andy Reid@lemmy.world to Technology@lemmy.worldEnglish · 7 months agoAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comexternal-linkmessage-square26fedilinkarrow-up10arrow-down10
arrow-up10arrow-down1external-linkAI companies are violating a basic social contract of the web and and ignoring robots.txtwww.theverge.comAndy Reid@lemmy.world to Technology@lemmy.worldEnglish · 7 months agomessage-square26fedilink
minus-squareLvxferre@mander.xyzlinkfedilinkEnglisharrow-up1·edit-27 months agoYup, it’s the same approach as email spam traps. Except the naughty list, but… holy fuck a shareable bot IP list is an amazing addition, it would increase the damage to those web crawling businesses.
Yup, it’s the same approach as email spam traps. Except the naughty list, but… holy fuck a shareable bot IP list is an amazing addition, it would increase the damage to those web crawling businesses.