114
Elon Musk blames data scraping by AI startups for his new paywalls on reading tweets
(www.theverge.com)
this post was submitted on 02 Jul 2023
114 points (98.3% liked)
Technology
58012 readers
3121 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
This isn’t how you handle automated processes scraping you, you handle that by restricting things that human beings can’t do. Preventing literally every user from seeing a reasonable amount of content is just cutting off your nose to spite your face.
I’m in IT for a company with a significant web presence. We rely on Akamai for a number of services including CDN and WAF (web application firewall). They have a WAF add-on called Bot Manager that can pretty accurately identify web traffic from bots in real time. If what Musk is claiming was true then tools like Akamais Bot Manager and other similar products would easily identify this traffic and allow them to block it or route it elsewhere.
Musk should know this. I know Tesla uses Akamai.
I'm pretty sure he doesn't wanna pay such service and prefer cheaper / easier way.