Track_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 4 days agoRISE UPslrpnk.netexternal-linkmessage-square14fedilinkarrow-up1618arrow-down18
arrow-up1610arrow-down1external-linkRISE UPslrpnk.netTrack_Shovel@slrpnk.net to Lemmy Shitpost@lemmy.worldEnglish · 4 days agomessage-square14fedilink
minus-squareTheTechnician27@lemmy.worldlinkfedilinkEnglisharrow-up29·4 days agoThe inverse of robots.txt: crawling robots without their consent.
The inverse of robots.txt: crawling robots without their consent.