A Boring Dystopia

9788 readers

185 users here now

Pictures, Videos, Articles showing just how boring it is to live in a dystopic society, or with signs of a dystopic society.

Rules (Subject to Change)

--Be a Decent Human Being

--Posting news articles: include the source name and exact title from article in your post title

--If a picture is just a screenshot of an article, link the article

--If a video's content isn't clear from title, write a short summary so people know what it's about.

--Posts must have something to do with the topic

--Zero tolerance for Racism/Sexism/Ableism/etc.

--No NSFW content

--Abide by the rules of lemmy.world

founded 1 year ago

MODERATORS

[email protected]

947

He really wants to kill that platform lol (lemmy.world)

submitted 3 months ago by [email protected] to c/[email protected]

106 comments fedilink hide all child comments

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 11 points 3 months ago (1 children)

Is there a way to fully download or scrape a full subreddit or say stackoverflow since they've both committed themselves to enshittification and alienating their userbases?

asking because that seems difficult to do and there's a lot of useful information on both sites

[–] [email protected] 7 points 3 months ago

Its not super hard, but the main hurdle will by bypassing whatever api limits there are such as by using multiple accounts

Certain libraries like praw still work to some extent (my discord bot is still running somehow) but trying to scrape all of the posts in a sub might have to be done slowly. You might be able to sort by old so that the results dont move relative to the page and then go page by page.