this post was submitted on 03 Jul 2023
2615 points (98.1% liked)

Technology

59107 readers
3218 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Google has reportedly removed much of Twitter's links from its search results after the social network's owner Elon Musk announced reading tweets would be limited.

Search Engine Roundtable found that Google had removed 52% of Twitter links since the crackdown began last week. Twitter now blocks users who are not logged in and sets limits on reading tweets.

According to Barry Schwartz, Google reported 471 million Twitter URLs as of Friday. But by Monday morning, that number had plummeted to 227 million.

"For normal indexing of these Twitter URLs, it seems like these tweets are dropping out of the sky," Schwartz wrote.

Platformer reported last month that Twitter refused to pay its bill for Google Cloud services.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 14 points 1 year ago (1 children)

I don't think Twitter would rate limit the Google indexer, though.

It's probably the increased bounce rate, as people click Twitter links in the search results, get Twitter's login wall and click back to continue searching instead of creating an account.

[–] [email protected] 23 points 1 year ago (1 children)

I tried to access twitter by impersonating a googlebot. I was denied. The bots aren't so much rate limited, but unable to access tweets as they don't have a Twitter account.

[–] [email protected] 7 points 1 year ago

Impersonating a Googlebot user-agent isn’t a perfect test though, since you’re supposed to implement IP verification too - either checking against a known list of Google crawler IPs or doing a PTR lookup. See https://developers.google.com/search/docs/crawling-indexing/verifying-googlebot

Question is whether or not Twitter has competent software developers implementing stuff correctly anymore. Anyone’s guess at this point.