shish_mish@lemmy.world to Technology@lemmy.worldEnglish · 4 months agoGoogle Is the Only Search Engine That Works on Reddit Now Thanks to AI Dealwww.404media.coexternal-linkmessage-square34fedilinkarrow-up1180arrow-down16
arrow-up1174arrow-down1external-linkGoogle Is the Only Search Engine That Works on Reddit Now Thanks to AI Dealwww.404media.coshish_mish@lemmy.world to Technology@lemmy.worldEnglish · 4 months agomessage-square34fedilink
minus-squarereddig33@lemmy.worldlinkfedilinkEnglisharrow-up4·edit-24 months agoI also don’t know if a law that says search engines have to honor a robots.txt file. I guess we will see what happens if Bing or some other service decides to ignore it.
minus-squareEvotech@lemmy.worldlinkfedilinkEnglisharrow-up1·4 months agoYou can just require a log in to view content, or just flat out auto ban indexing robots.
I also don’t know if a law that says search engines have to honor a robots.txt file. I guess we will see what happens if Bing or some other service decides to ignore it.
You can just require a log in to view content, or just flat out auto ban indexing robots.