UngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 1 year agoSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comexternal-linkmessage-square35fedilinkarrow-up1179arrow-down11cross-posted to: tech@kbin.social
arrow-up1178arrow-down1external-linkSites scramble to block ChatGPT web crawler after instructions emergearstechnica.comUngodlyAudrey🏳️⚧️@beehaw.org to Technology@beehaw.org · 1 year agomessage-square35fedilinkcross-posted to: tech@kbin.social
minus-squarem-p{3}@lemmy.calinkfedilinkEnglisharrow-up26·1 year agoLemmy.ca added a block at the nginx level for it https://lemmy.ca/comment/1999439 # curl -H 'User-agent: GPTBot' https://lemmy.ca/ -i HTTP/2 403
minus-squareThe Bard in Green@lemmy.starlightkel.xyzlinkfedilinkEnglisharrow-up3·1 year agoHilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…
minus-squarem-p{3}@lemmy.calinkfedilinkarrow-up5·1 year agoI know but at this point you do what you can.
Lemmy.ca added a block at the nginx level for it
https://lemmy.ca/comment/1999439
# curl -H 'User-agent: GPTBot' https://lemmy.ca/ -i HTTP/2 403Hilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…
I know but at this point you do what you can.
deleted by creator