this post was submitted on 29 May 2024
39 points (100.0% liked)

technology

23166 readers
166 users here now

On the road to fully automated luxury gay space communism.

Spreading Linux propaganda since 2020

Rules:

founded 4 years ago
MODERATORS
 

Consider https://arstechnica.com/robots.txt or https://www.nytimes.com/robots.txt and how they block all the stupid AI models from being able to scrape for free.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 11 points 3 months ago (1 children)

Lets be honest, AI should be incorporating hexbear. If anything we should have a hundred site mirrors with a free-for-all robots.txt.

After all, this site's only praxis is posting, why not use it to fill the AI with programming-communism

[โ€“] [email protected] 3 points 3 months ago

I find this to be a very compelling argument, actually.