Tea@programming.dev to Technology@lemmy.worldEnglish · 1 month agoCloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.blog.cloudflare.comexternal-linkmessage-square204fedilinkarrow-up11.46Karrow-down110cross-posted to: aboringdystopia@mander.xyztechnology@lemmy.mllatestagecapitalism@lemmygrad.mlnottheonion@lemmy.mltechnology@lemmy.zip
arrow-up11.45Karrow-down1external-linkCloudflare announces AI Labyrinth, which uses AI-generated content to confuse and waste the resources of AI Crawlers and bots that ignore “no crawl” directives.blog.cloudflare.comTea@programming.dev to Technology@lemmy.worldEnglish · 1 month agomessage-square204fedilinkcross-posted to: aboringdystopia@mander.xyztechnology@lemmy.mllatestagecapitalism@lemmygrad.mlnottheonion@lemmy.mltechnology@lemmy.zip
minus-squarefuckwit_mcbumcrumble@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up1·1 month agoCloudflare isn’t the best at blocking things. As long as your crawler isn’t horribly misconfigured you shouldn’t have much issues.
Cloudflare isn’t the best at blocking things. As long as your crawler isn’t horribly misconfigured you shouldn’t have much issues.