this post was submitted on 29 Jan 2025
1 points (100.0% liked)

It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
 
The original post: /r/datahoarder by /u/WitherBoss on 2025-01-28 19:59:41.

As someone who probably has a LOT more bookmarks saved than I should have, a lot of the solutions i've come across regarding extracting Twitter bookmarks either are outdated or don't overcome my main issue. While I am able to save some of my bookmarks, after about 15k bookmarked tweets the page artificially stops you from seeing more. A few more tweets are loaded into the html but they aren't displayed.

However, if you unbookmark a few tweets or even just manually delete some earlier ones from the HTML then the page will continue to load more of your bookmarks, so it's not a hard wall. I've tested some Javascript to try and "delete" tweets to push up some of my older bookmarks, but i've consistently been getting errors to do with memory at around the 1500 mark and have been having trouble getting around it. The optimal solution would be to save and unbookmark them at the same time but that runs the risk of the code messing up and me losing some chunks of the bookmarks.

The main point is, does anyone have a solution to this? Either a working bookmark scraper post-API change or a way that I can get around the memory issues.

no comments (yet)
sorted by: hot top controversial new old
there doesn't seem to be anything here