Ayhem@lemmy.world to Artificial Intelligence@lemmy.worldEnglish · 1 year agoWebsites blocking OpenAIlemmy.worldimagemessage-square13fedilinkarrow-up163arrow-down14file-text
arrow-up159arrow-down1imageWebsites blocking OpenAIlemmy.worldAyhem@lemmy.world to Artificial Intelligence@lemmy.worldEnglish · 1 year agomessage-square13fedilinkfile-text
minus-squareAggressivelyPassive@feddit.delinkfedilinkEnglisharrow-up6·1 year agoRobots.txt never was any hurdle, it’s just a flag which you are free to ignore.
Robots.txt never was any hurdle, it’s just a flag which you are free to ignore.