It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
201
 
 
The original post: /r/datahoarder by /u/covered1028 on 2025-07-27 17:45:35+00:00.

I have a lot of youtube duplicates, they have the video ID in the filename. I downloaded in various resolutions, re-downloaded in higher resolutions as I had more space available.

I don't need those special features that compare contents of videos, only needs to match the filename I think the 11 character video ID and I'll sort by filename and delete.

202
 
 
The original post: /r/datahoarder by /u/danshat on 2025-07-27 17:25:27+00:00.
203
 
 
The original post: /r/datahoarder by /u/Markus2822 on 2025-07-27 17:23:49+00:00.
204
 
 
The original post: /r/datahoarder by /u/varignet on 2025-07-27 17:14:20+00:00.

I thought ssds trim and hdds defrag.

I stumbled across two wd external hdds (probably smr) that have trim support and are indeed trimmed.

It doesn’t make sense to me, what am I missing?

205
 
 
The original post: /r/datahoarder by /u/anvil-14 on 2025-07-27 16:18:02+00:00.

I have 2 seagate drives that are Out of Warranty and were marked as bad/failed in ZFS. what can I do to test and mark the bad blocks on these disks so that I can add these drives back to my ZFS pool?

206
 
 
The original post: /r/datahoarder by /u/timecat22 on 2025-07-27 16:04:23+00:00.

I have a 1024 GB SSD. It's my primary hard drive. It contains all my work files, all my software, all my everything. I cannot risk this drive under any circumstances.

I amazon'd a second drive to use as a backup. It's unfortunately slightly smaller. I didn't realize that when I selected it.

My main drive is not full or anything. The second drive has more than enough space to contain all of the actual data on my main SSD. I want to create a complete clone of my C drive on this new drive. In theory the new drive would have less empty space on it but everything else would be intact.

What is the most straightforward and reliable way to clone my SSD to this smaller SSD? I have tried numerous methods including AOMEI backupper, Macrium Reflect, Clonezilla, and so far I have been rewarded with BSODs, "firmware panics", error messages, and a full day of being unable to boot my PC.

What can I do? Is there a safe way to do this? Many thanks in advance

207
 
 
The original post: /r/datahoarder by /u/Duldain on 2025-07-27 14:32:51+00:00.

I've bought a WD Passport 5Tb as an additional external back-up source. I've started coping files with rsync and after about 300Gb, getting too hot (lots of small files), the drive kept disconnecting. Now it's working on usb 2.0 and when it cooled down also on 3.0.

However, I've decided to send it back for a refund and get a standard 3.5" HDD and use it via a dock. I want to make sure that whatever I copied so far is not recoverable so I am cleaning up the files via Bitdefender File Shredder. It takes however quite a long time, since there were around 2mil files in 300Gb. Is there a better, safer, faster way of making sure data is not recoverable from a drive?

208
 
 
The original post: /r/datahoarder by /u/DapperBoiCole on 2025-07-27 13:44:40+00:00.

Hi, I hope this is okay to ask. I'm an American with no experience in archiving, but I've been saving links to posts and videos on Facebook and Instagram that I would like to preserve. My first thought would be to download the contents and put it on some kind of usb or disk but after theyre off the platform I'm not sure how to properly preserve these posts/videos offline or online. So I have two questions.

  1. What would be the best way for me to get the posts or videos off if Facebook and Instagram into a viewable format.
  2. Once I have transferred the content, how do I best store it physically and digitally. Are there digital libraries for this sort of thing? I only have a laptop and I would like storage I can transport easily if I choose to travel (plane).
209
 
 
The original post: /r/datahoarder by /u/Sudden-Wash4457 on 2025-07-27 12:57:59+00:00.
210
 
 
The original post: /r/datahoarder by /u/Obvious-Viking on 2025-07-27 10:49:48+00:00.
211
 
 
The original post: /r/datahoarder by /u/EnduringIdeals on 2025-07-27 10:18:48+00:00.

A friend of mine has a burned copy of Cinderella on DVD where the colors are a mess. Green teeth, neon hair, purple sun, just wild color errors but everything else is fine. I'm trying to puzzle out what caused this. It was recorded on a DVD to DVD device 20-something years ago. Does anyone have any idea what went wrong?

212
 
 
The original post: /r/datahoarder by /u/poggs on 2025-07-27 08:46:34+00:00.

I have a semi-organised archive of software and data to be shared with five or six other people. The sharing part isn't a problem - plenty of software to do that, but I'm looking for some software that will allow us to store metadata against each file and sync it as part of the archive. Ideally we'd like to be able to create groups of files too, but this isn't essential.

I tried Sharepoint but became frustrated within eight seconds, and then came to a bit of a dead end. Is there any Open Source software that will manage metadata in a sensible, non-proprietary way?

213
 
 
The original post: /r/datahoarder by /u/km96 on 2025-07-27 06:59:12+00:00.

Hey Internet.

I can't be the only one dissatisfied with every single self-hosted ebook/comic solution out there right now. Here's my list of demands:

  1. Self-hosted (duh)

1a. Can run on a Synology NAS either via native package or Docker/Docker Compose 2. Plays nicely with an iPad-- used for comics (and to a lesser extent, technical ebooks) 3. Plays nicely with a Kobo ebook reader-- used for non-fiction/technical ebooks/sci-fi 4. Supports shared "pages read" progress 5. A single book can be in several formats on-disk ("the_eggo_man.epub", "the_eggo_man.pdf", "the_eggo_man.cbz") without being represented in the solution multiple times: "The Eggo Man" > Formats: epub, pdf, cbz 6. Content-based identity detection. When provided files, ISBN10/ISBN13/Library of Congress is surmised based on said contents and correlated with any number of (free) metadata services

6a. The ability to read metadata from/interface with, Humble Bundle

As of yet, I've tried Calibre, CWA, Komga, Kavita, Booklore, Bookfusion, Mylar, etc. I haven' tried audiobookshelf, but I'm tired man.

214
 
 
The original post: /r/datahoarder by /u/FluffyMumbles on 2025-07-27 07:23:26+00:00.

I have a Crucial 2.5" SSD that I suspect is borked. I've installed it in two systems in the past month and both times it appears to have caused issues with the filesystem (files being inaccessible).

I want to give this a proper test before I make a warranty claim (in case it's being being dumb) but I'm overwhelmed with all the different tool options.

What's the go-to these days? I want to boot from an image, point it at the drive and have it tell me if it's good, or if it's bad and why.

215
 
 
The original post: /r/datahoarder by /u/SnooDoughnuts6877 on 2025-07-27 07:07:15+00:00.
216
 
 
The original post: /r/datahoarder by /u/spinnerspin1 on 2025-07-27 05:58:00+00:00.

What's the best multi HDD Bay enclosure with raid 5 support? ideally Gen 2 USB 3.0. Budget is under $250 but ideally $150-200 if possible..

217
 
 
The original post: /r/datahoarder by /u/munkiemagik on 2025-07-27 02:37:37+00:00.

I had an epic wally moment earlier. I seem to be all about the jank with everythign I do these days and have built a new open air frame threadripper system with a hot swap caddy to house my 16TB Exos HDD's array. As I was shoving that into the rack as best as I could. I perched the hotswap caddy right on the front edge as I miscalcualted sizes and things didnt fit how I tought they would. Well fast forward to plugging in power cables at back of new system. At least I had some sense to make sure everything was switched of and it was just cold unpowered cables going in. So nothign spinning.

But like the donkey that I am, I carelessly pushed too hard on the frame as i was pluggin in power and that nudged the HDD caddy forward off the front of the shelf and it tipped off the rack!!!

The whole thing fell slgihtly off-vertical, total drop was about 6 inches onto soft carpet. Everythign starts up fine and no errors have been reported. Did I get lucky??? Or is my day of reckoning just around the corner?

218
 
 
The original post: /r/datahoarder by /u/evildad53 on 2025-07-27 02:36:23+00:00.

My PC has a couple of M2 drives and a 2.5" SSD, plus a 4TB WD Black drive that's full. I also have a JBOD with a couple of Exos and an IronWolf drive. I'm looking for a replacement for that 4TB that would be primary, active storage for my photos and video. (I'd use an M2 as video editing and then save the results back to the spinning disk) Looking at GoHardDrive and ServerPartsDeals, I can get a 14TB Ultrastar HC530 (that's CMR) for $150, or a 12TB IronWolf for $180.

Would you buy a manufacturer recertified drive for inside your PC? Or should I look for a new drive?

If so, would you choose the Ultrastar or the IronWolf? Does it matter if you're using a "NAS" drive inside your PC? Which would be louder? Which would have better performance?

Thanks.

219
 
 
The original post: /r/datahoarder by /u/7yellowgummybears on 2025-07-27 01:52:46+00:00.

I've bought a scanner and want to scan photos for friends. What is the best way to store other people's data in a way they can easily access? I need a cloud based service where the viewer can see their high quality pics but noone else's.

220
 
 
The original post: /r/datahoarder by /u/No_Match_5106 on 2025-07-27 01:45:48+00:00.

I finally got a NAS and so far I'm storing large files on there such as footage from various projects. I also have important documents such as prescriptions, tax returns, and financial documents that I frequently access that I keep in my computer. My question is should I keep those documents and back them up to the NAS occassionally? Or should I move them to the NAS and access them via SMB?

My NAS is currently being backed up to S3 Glacier Deep Archive and an external USB. I suppose if my keep it in my computer, it adds another "layer" of backup. I'm curious to know what would r/DataHoarder or r/datacurator do?

221
 
 
The original post: /r/datahoarder by /u/AdityaPatel149 on 2025-07-27 01:28:58+00:00.

https://www.ifixit.com/products/external-m-2-ssd-nvme-enclosure

Does it use the RTL9210 or JSM583 controller? How is it compared to SSK or Ugreen options on amazon?

222
 
 
The original post: /r/datahoarder by /u/N5tp4nts on 2025-07-26 21:24:14+00:00.

I have a couple of podcasts I'd like to archive. Is there an app I can give a feed to and have it download everything and stay in sync? Preferably a docker I can run on unraid.

223
 
 
The original post: /r/datahoarder by /u/NEON725 on 2025-07-26 21:15:20+00:00.

Features:
* Runs without any GUI environment. Suitable for servers and the cloud.
* Automatically keeps games updated during successive uses.
* Support for downloading from MEGA links as well as itch-native uploads.
* Automatic archive extraction.
* Uses itch.io's own "Collections" feature to create download lists.
* Filter based on desired platform(s).
* No use of AI during development.

There is also a docker image, but it's currently lacking documentation: https://hub.docker.com/r/neon725/butler_archivist

This tool started as a personal project to let me update games on my steam deck via syncthing in the background without manually launching the itch.io app. It's worked well for that purpose in my own homelab, but in light of the recent controversy, I figure other people might like to start data hoarding. I've spent the last few days cleaning up the rough edges, adding error handling and some light documentation, preparing it for containerized deployments like docker and kubernetes, and adding the `--no-remove` parameter, which prevents games from being uninstalled if they are delisted from the site.

Note that this tool cannot do anything that the itch desktop app can't do, with the exception of MEGA support that had to be implemented myself.

Happy hoarding!

224
 
 
The original post: /r/datahoarder by /u/MrCatberry on 2025-07-26 19:09:02+00:00.
225
 
 
The original post: /r/datahoarder by /u/nachoha on 2025-07-26 18:38:48+00:00.
view more: ‹ prev next ›