It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
6476
 
 
The original post: /r/datahoarder by /u/MrAcademics on 2024-09-17 08:14:32.

Hey all, Mac mini M1 connected to my 8TB SATA SSD via USBC . I finally hit capacity and I realise this ain’t a lot of data vs others here.

Just wondering what would be a good way to expand my storage capacity while keeping my plex server as the Mac mini.

Ideally I would like to maintain SATA SSD level transfer speeds and having the option to expand any setup recommendation with additional capacity drop in style would be ideal.

SSD based options would be my preference but I’m happy to look at everything. TIA

6477
 
 
The original post: /r/datahoarder by /u/Hotchipsandpepsi on 2024-09-17 04:54:50.

I’m gonna know the answer to this on my next paycheck since I’m getting a new laptop that has 3.2 ports but I still would like an answer to this for the time being. The t7 supports up to 1050mb/s read speeds I believe on a 3.2 port, but nowhere seems to tell me if 450mb/s is normal on a 3.0 port. I read 3.1 doubles which would make 3.2 true to its label right?

6478
 
 
The original post: /r/datahoarder by /u/jaybayblay on 2024-09-17 04:52:15.

I was wondering if it's better to buy a NAS HDD over a regular HDD for data storage? I plan to keep it in an aluminum usb-c hard drive enclosure. I dont plan to use it often at all, simply for movies/shows and hope it lasts for years. Any advice would be appreciated!

6479
 
 
The original post: /r/datahoarder by /u/EchoGecko795 on 2024-09-17 03:28:22.
6480
 
 
The original post: /r/datahoarder by /u/TvHead9752 on 2024-09-17 01:43:02.
6481
 
 
The original post: /r/datahoarder by /u/BM99 on 2024-09-17 00:47:21.

Hello everyone. I am currently running Unraid on a Dell mini pc, so in order to add drives I ended up using external USB drive bays (NexStar TX: https://a.co/d/88l7iKZ). These worked for a while, but my hard drives kept dying after a few months of what I would consider light usage in the grand scheme of things. I decide that it must be the used hard drives I keep buying, so I buy a new hard drive, boom dead in less than 3 weeks. After doing a little thinking I come to the conclusion that these drives must be dying due to heat. During some operations they will run for 20+ hours straight, and me being new to this I didn't think that 50C was going to to any damage.. Long story short I bought a 4 drive external bay with a cooling fan after reading a lot of reviews online (https://a.co/d/8Em3byD). After setting everything up my drives are still going above 50C, so I'm not too thrilled... Does anyone know of any decent DAS drive bays with good cooling? I'd like to avoid building it out in a whole pc chassis if possible, but I'd also like to stop losing drives.

TLDR: Drives are hitting 50+C and dying, current DAS solution is not properly cooling drives.

6482
 
 
The original post: /r/datahoarder by /u/Diligent-Salt8089 on 2024-09-16 23:35:59.

I’ll keep it short, I’ve had hardrives since I was like 18 so I have a good amount of them over the years.

They have insane amount of stuff on them from college, university, travelling, work, thousands and thousands of photos and videos on them. From when I’ve just wanted to wipe my laptop or iPhone I just move EVERYTHING over. So theres probably some private stuff on there I don’t even know about. Nothing illegal of course but more just personal stuff you wouldn’t want in a strangers hands or something.

I’m looking at all these hardrives and thinking I might have to go through them and completely declutter but it seems like such an effort. None of it is really organised either lol.

There’s rare occasions when I need/want to find something from those eras and plug them in so they’re handy at times but I don’t know, i feel so overwhelmed. Anyone else?

What do you do with it all?

I feel like I should have them all in one place with like a password on them or something.

EDIT: off to bed but just read a few will check more in morning, looks like multiple recommending a NAS but I have no idea what that is

6483
 
 
The original post: /r/datahoarder by /u/Saaammmy on 2024-09-16 23:15:47.

I've been looking for ways to download a series online, is there a way to download videos from online players? I travel frequently and I want to kill time. Thanks in advance.

6484
 
 
The original post: /r/datahoarder by /u/P-D-S-A098 on 2024-09-16 23:15:45.

So I’m saving up for a new NAS to go from 7tb in my main pc to eventually a setup that can hold up to 12 drives I wanted to ask what is the cheapest way to get 12 drives that won’t make the drives last less and still be reliable?

Case I’m planning is the n5

6485
 
 
The original post: /r/datahoarder by /u/budflight on 2024-09-16 22:35:40.

I currently have to OWC Thunderbay 4s, one is 16TB and the other is 20TB. I don't know that I need RAID 5 (and I use Softraid but am now being asked to pay $149 and $79 per year to get the premium features).

I had a drive go bad today and its replacement will be here tomorrow. Curious of my options to get away from SoftRaid and do I even need RAID 5? My 20TB is a backup of my 16TB and I have Crashplan for all of my imagery and I use Time Machine for my local machine.

6486
 
 
The original post: /r/datahoarder by /u/AmarilloClown on 2024-09-16 21:42:42.

I have about 100 external hard drives that I like to have for backups of my backups, one of my drives died a couple months back, which was sad, but I thought I’d give it another try, make sure it wasn’t working, and plugging the drive in knocked out power to my entire apartment 😅 I have no clue why this would happen any suggestions would be appreciated lmao. Like faulty cord maybe? Just seems strange

6487
 
 
The original post: /r/datahoarder by /u/FortunesOfWarr on 2024-09-16 21:06:31.

I’m trying to get some documents from the Gaming Alexandria site but it would be far easier if I didn’t need to click multiple individual links. I couldn’t find any info on FTP access so it doesn’t seem possible. Does anyone know if there’s some way to batch download from the site?

6488
 
 
The original post: /r/datahoarder by /u/tytest_69 on 2024-09-16 20:38:51.

I'm looking for a program for Mac OS that can create a single image that shows multiple screenshots from a bunch of movies in a folder. I'm unfortunately not comfortable using command line so any help would be appreciated.

6489
 
 
The original post: /r/datahoarder by /u/chris_xy on 2024-09-16 20:30:47.

I have a couple concerns for cloud backups, i want them encrypted but am afraid of data corruption and then losing everything because it cant be decrypted anymore.

So i found par2 for file repair. Therefore I am thinking about using this script:

‘’’ tar cf - -C ${INPUT_FOLDER} ${BACKUP_FOLDER}|
openssl enc -aes-256-cbc -salt -pbkdf2 -pass pass:${PASSWORD}|
split -d -b 256M - ${FILENAME}

for file in ./* do

echo "Creating redundance for ${file}"

nice -n5 par2create -t4 -r5 -b4096 ${file} done ‘’’

With additional file splitting to improve performance of par2create so it easily fits into ram.

What would you change, how did you setup your backups?

6490
 
 
The original post: /r/datahoarder by /u/-BlackLotus- on 2024-09-16 20:04:13.

I originally started with a Synology DS216play equipped with 2x 8TB drives. Over time, it has been demoted from being my primary server to functioning as an SMB share for bulk storage, as its ability (or lack thereof) to containerise and transcode was preventing me from using it as I intended.

Now my primary server is a Lenovo ThinkStation P360 Tiny, upgraded to 64GB of RAM, and is now responsible for all my containerisation and transcoding needs (Pi-hole, Jellyfin, ARR stack, Home Assistant, game servers, etc.). It has been performing rather well considering how small of a machine it is. The only major hindrance is the limited storage space, which I resolved by using my Synology SMB share as its main storage.

However, I am now running out of space and need to expand (ideally doubling my storage or more) but I’m unsure what solution would work best for this setup and would be interested to hear other people's opinions.

The options as I see them:

Buy another Synology or QNAP and SMB share as I do currently.

My concern with this option is that I would end up not utilising 90% of what the system is built for, making it possibly a very expensive storage solution.

Using JBOD/DAS

This was my initial thought, as it would be relatively easy to plug in a 6 or 8-bay DAS, fill it with drives, and run an Unraid container to manage it. However, I’ve read a lot of complaints about cheap controllers and the lack of unique device identifiers causing drive detection issues. Additionally, it's a one-time upgrade since, once my USB slot is filled, there's no room for further expansion (though I’m not sure if this is a real issue or not).

Building a custom tower

The last option I’ve found is to build a custom tower specifically to act as network-attached storage, running Unraid or TrueNAS. Although I have no major issues with this idea, I’m not sure what a system like this should look like to keep it affordable and efficient to run.

Also open for any other suggestions.

6491
 
 
The original post: /r/datahoarder by /u/TimeytheSissy on 2024-09-16 19:47:20.

My situation is that I'm at college/uni and I have a laptop with a 1TB internal ssd that I want a working copy of my backed up files on (about 450 gb)

I have a computer at my home pc that has a hard drive I also want a working copy of my data on

I have two external HDD's that I want to use as a backup in a raid/auto parity configuration

I want to be able to take my working copy from my laptop and back it up onto one of these external hard drives that I'll have with me at college and when I go home I can take this external hard drive I plug it in and it automatically will update changed files on the other hard drive without having to completely rewrite all the data, and it'll update the working copy of these files on my home pc, then when I go back to college with any changes on the external hdd it'll update the working copy on my laptops ssd

my understanding is that if I do a raid config when I separate the external drives I won't be able to easily access the data at college and they'll be confused on who to rebuild who from/will want to do a full rebuild. And it's not automatically updating my working copy. So what software can I use instead? Maybe git?

6492
 
 
The original post: /r/datahoarder by /u/asdfghqwertz1 on 2024-09-16 19:38:43.

My friend had a 4TB WD purple drive in his surveillance system, but he won't use it anymore and could give it to me for free. IIRC it ran for 10k hours in about 5 years, but works without any issues.

6493
 
 
The original post: /r/datahoarder by /u/DoomPaDeeDee on 2024-09-16 18:53:08.

The SSD is in an older Dell XPS notebook that was used for less than 72 hours total.

The cost of buying a USB 3 enclosure for it and the relatively low capacity makes me think it's probably not worth it when comparing to the cost of a 256GB USB C stick drive. The only use would be to use as an external drive for a desktop computer and I already have an external HDD and don't need a portable drive.

Are there any uses for or advantages of the SSD that I might not be aware of?

The alternative would be to recycle the computer because it's not worth much used, so I probably wouldn't go to the trouble of selling it, realistically.

6494
 
 
The original post: /r/datahoarder by /u/Il_Mondo_Distorto on 2024-09-16 18:18:39.

Hi everyone, I am planning to buy an external hard drive to store movies, pics and something like these. It will not always be on or connected, I will connect it only when I will need it. I have found a WD Elements 10tb almost new for 120€, but I don't know if there are better alternatives for that price.

6495
 
 
The original post: /r/datahoarder by /u/KWalthersArt on 2024-09-16 18:01:26.

Trying to transcribe a lot of old tapes, in the process I decide to use a different pc for capture and it's fighting the capture drivers. I can't seem to install my vc500 so are there any better affordable capture cards? I have an Hauppauge pvr but I think it has internal encoding

6496
 
 
The original post: /r/datahoarder by /u/Apptryiguess on 2024-09-16 17:49:49.

https://preview.redd.it/0ng7w3ill7pd1.png?width=697&format=png&auto=webp&s=8e17dcf1eb3f1b4956b9577a6eda7a85dc451931

https://preview.redd.it/vvvxj4ill7pd1.png?width=1919&format=png&auto=webp&s=53208b65db8dc29727745ccbe2cc18e2125e8519

https://preview.redd.it/9asjr5ill7pd1.png?width=1687&format=png&auto=webp&s=6d08c1d371bf9830f77dd3c948ad78282bbaf26f

I just did a defragg on this G drive through the windows built in defrag tool. After almost two full days its finally complete and windows even after analyzing again shows 0% fragmentation. Defraggler on the other hand shows quite a lot of fragmentation but still says its only at 10%, Auslogics defragging tool shows over 50% fragmentation... who do I believe here?

Like I said, the defrag took almost two full days and went through multiple passes with the windows defrager, should that not have fully defraged the drive? Why are the other programs still showing so much fragmentation and why are their percentages so totally off?

6497
 
 
The original post: /r/datahoarder by /u/Ottetal on 2024-09-16 15:27:22.
6498
 
 
The original post: /r/datahoarder by /u/wspnut on 2024-09-16 14:47:35.

Hey all -

I have a growing data pool I'm trying to determine cost-effective backup options for. I'm currently looking to pass 100TB at EOY and likely will double that into the 200TB+ range next year. All data is currently on 5-drive raidz2 ZFS VDEVs, but not backed up. It isn't mission critical data, but loss would definitely suck.

I figure my options are tape or BD-R. Tape seems quite expensive up front, while BD-R may be more expensive in the long run per-disk. I'm curious if I'm missing any options, or if anyone has implemented a similar backup solution for this size (or more) at a reasonable cost in 2024.

Thanks!

6499
 
 
The original post: /r/datahoarder by /u/TheDarkLordDarkTimes on 2024-09-16 14:34:49.

Have a few 8tb and a few 10/16tb.

Looking to upgrade for the larger 22TB to make some redundancy. Been keeping on eye on shocks.top for a while, I missed out the last great sale it had. Think it will go down by Thanksgiving and Christmas time or will there be an uprising cost In the coming years? Good times for 8tb WD Easystore for $119.

6500
 
 
The original post: /r/datahoarder by /u/StolenWishes on 2024-09-16 14:32:15.

I submitted the following URL roughly an hour ago. It's moved only a couple hundred places in the queue, with 8600 to go.

Anybody else seeing this? Has Bloomberg perhaps implemented a tarpit?

https://www.bloomberg.com/news/articles/2024-09-16/bankers-want-to-work-long-hours-on-interesting-deals-lazard-ceo-says

view more: ‹ prev next ›