Luu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 day agoTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comexternal-linkmessage-square73fedilinkarrow-up1415arrow-down16
arrow-up1409arrow-down1external-linkTikTok’s parent launched a web scraper that’s gobbling up the world’s online data 25-times faster than OpenAIfortune.comLuu Tuyen@lemmy.world to Technology@lemmy.worldEnglish · 1 day agomessage-square73fedilink
minus-squareMojave@lemmy.worldlinkfedilinkEnglisharrow-up9·18 hours agoThey obfuscate their traffic by randomizing user agents, so it’s either add a global rate limit, or let them ass fuck you
They obfuscate their traffic by randomizing user agents, so it’s either add a global rate limit, or let them ass fuck you