this post was submitted on 27 Dec 2025
1159 points (99.2% liked)

Technology

78029 readers
3336 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
L3s@hackingne.ws
L4s@hackingne.ws
1159
Nearly all of Spotify has been scraped and is available via torrents (www.soundguys.com)
submitted 1 day ago by commander@lemmy.world to c/technology@lemmy.world
183 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] Piece_Maker@feddit.uk 18 points 23 hours ago (1 children)

Torrents manage this without any extra tech. Just grab the .torrent file, and only select the files you have space for. Download them then seed, and get your 150 friends to do different files. If I then go to download a file that's in your batch, the download will happen from your server (and whoever else is seeding these files), and if I go to download a file that's on one of your 150 others' server it'll download from there.

[–] Knock_Knock_Lemmy_In@lemmy.world -3 points 21 hours ago* (last edited 16 hours ago) (1 children)

Yes, almost. But i want it to seem like i have all 400tb on my 3tb drive. I want the cache to handle downloads automatically and I want an even spread of files so that none get lost.

Torrents give me:

  • Chunking
  • Redundancy via multiple seeders
  • Partial downloads

But they do not give me:

  • A unified filesystem view
  • Automatic caching & eviction
  • ~~Guarantees that every file stays available~~
  • User side load balancing or placement control
  • ~~A way to say “this file must exist on N peers”~~

Maybe I should be typing this into a LLM.

Edit: ChatGPT is suggesting an IPFS Cluster

Edit 2: If the torrents stays active I can remove some requirements

[–] Piece_Maker@feddit.uk 3 points 20 hours ago (1 children)

Ahh fair enough! Yeah, not sure about all that.

A very long time ago I remember there being FUSE filesystems that allow you to mount a .torrent like a network drive. I have no idea if these are still kicking though. Still doesn't provide all of your extra bullet points but might be a good start to the rabbit hole

[–] Knock_Knock_Lemmy_In@lemmy.world 2 points 18 hours ago

Fuse looks like a good way to make the 3tb look like 400tb but it doesn't do the replication bit.

I'm commenting these ideas publicly because maybe others will join in. Thanks for playing along!