this post was submitted on 27 Dec 2025
1145 points (99.2% liked)

Technology

78029 readers
3350 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] Knock_Knock_Lemmy_In@lemmy.world 9 points 23 hours ago (1 children)

I have 3gb of space to share. Are there 150 other people like me that want to do some distributed hosting? What technology can handle this?

[–] Piece_Maker@feddit.uk 18 points 21 hours ago (1 children)

Torrents manage this without any extra tech. Just grab the .torrent file, and only select the files you have space for. Download them then seed, and get your 150 friends to do different files. If I then go to download a file that's in your batch, the download will happen from your server (and whoever else is seeding these files), and if I go to download a file that's on one of your 150 others' server it'll download from there.

[–] Knock_Knock_Lemmy_In@lemmy.world -3 points 19 hours ago* (last edited 14 hours ago) (1 children)

Yes, almost. But i want it to seem like i have all 400tb on my 3tb drive. I want the cache to handle downloads automatically and I want an even spread of files so that none get lost.

Torrents give me:

  • Chunking
  • Redundancy via multiple seeders
  • Partial downloads

But they do not give me:

  • A unified filesystem view
  • Automatic caching & eviction
  • ~~Guarantees that every file stays available~~
  • User side load balancing or placement control
  • ~~A way to say “this file must exist on N peers”~~

Maybe I should be typing this into a LLM.

Edit: ChatGPT is suggesting an IPFS Cluster

Edit 2: If the torrents stays active I can remove some requirements

[–] Piece_Maker@feddit.uk 3 points 18 hours ago (1 children)

Ahh fair enough! Yeah, not sure about all that.

A very long time ago I remember there being FUSE filesystems that allow you to mount a .torrent like a network drive. I have no idea if these are still kicking though. Still doesn't provide all of your extra bullet points but might be a good start to the rabbit hole

[–] Knock_Knock_Lemmy_In@lemmy.world 2 points 16 hours ago

Fuse looks like a good way to make the 3tb look like 400tb but it doesn't do the replication bit.

I'm commenting these ideas publicly because maybe others will join in. Thanks for playing along!