It's A Digital Disease!

The original post: /r/datahoarder by /u/zzzpotatozzz on 2024-09-07 18:59:39.

Looking for a NAS I think not entirely sure that's why im here. I have a bunch of external 4tb drives I wanna consolidate into one place. Photos, videos, music, and movies. I want it all in one spot. That can be backed up more easily then plugging two HDD into my pc, and waiting the 36 hours for it to copy over from one HDD to the other. Not to mention the duplicate file issues I run into. I also want to run plex, or jellyfin to watch my content around the house. Being not super into tech im not sure what other features i might need/want that I dont know exist due to being unfamiliar with these things. I'm looking for an off the shelf solution. I've built enough PCs to know I hate the process. From what I have looked up id say 4 Bay will be more then enough for my needs. It looks like Synolgy is my best bet, but their catalog of 7000 different options are overwhelming to say the least. Not to mention the competition I am lost. Thank you all in advance for your help.

The original post: /r/datahoarder by /u/a_sadnoLIFE on 2024-09-07 18:11:02.

I'm new to Data Hoarding, so I'd figure I try to maybe save my games onto some other hard drive to be able to play them without Steam

Edit: Little late to mention this, but the game in question is Payday 2.

The original post: /r/datahoarder by /u/Linksta35 on 2024-09-07 18:08:40.

Hello, I'm new to this data hoarding business. I've been doing extensive amounts of research and I think I've finally landed on a plan of attack that works for me.

My plan is to build my own NAS for my media storage which is mostly what this will be for. I'm going to start with 2 drives on TrueNAS running mirroring/RAID1. These will be the my first vdev for the pool. As I need more storage, I will continue to buy pairs of hard drives and create a new mirrored vdev to add to the pool. I know this cuts my storage in half and is probably not the best value, but it's simple and flexible.

Am I missing anything I should be considering or is this plan a okay? Thank you in advance for the help.

The original post: /r/datahoarder by /u/danuser8 on 2024-09-07 18:02:17.

Rookie data hoarder here, looking for others feedback.

Is ZFS too much for basic file storage, file sharing and media use?

The original post: /r/datahoarder by /u/smegtasticday on 2024-09-07 17:58:55.

My 3TB drive went from showing no bad sectors to over 70 after one day (thanks protection software)

I bought a new SSD to boot from and a new 10TB drive to clone the 3TB to.

Reckon any of the 3 options is safer? Thanks, am a data noob.

Copy all sectors

Copy all files

Copy all valid sectors according to the layout of the file system

The original post: /r/datahoarder by /u/kazumihypono on 2024-09-07 16:41:27.

I've a RAID 10 setup for a long time, using 4x 2TB Western Digital Caviar Black WD2002FAEX. 1 HDD failed.

I decided that it's time to slowly increase the capacity. I bought 2x 8TB Seagate Barracuda without researching. They cannot be returned.

So now, I have a RAID 10 with 2x WD and 2x Seagate.

It seems that the Seagate HDDs is prone to failure and I need another 2x ~5-8TB to increase capacity.

What HDD/SSD are you guys recommending? And what should I do with the 3x old good WD? (thinking another RAID 5 for random stuff)

So is this the right path? If not, what is your suggestion?

P/S: Forgot to add that the RAID is infrequently use. Like once a month mainly to backup data.

The original post: /r/datahoarder by /u/Mricypaw1 on 2024-09-07 15:59:23.

Im looking at storing long term backups of certain files on my NAS in veracrypt containers. I'm unlikely to mount / decyrypt the container very often, and will basically never modify / add to the contents of the container. The unmounted container file would be backed up to multiple locations (cloud, onsite backup etc). Is veracrypt suitable for these purposes? Is there anything specifically I should do to reduce the risk of corruption / data loss of the files in the container?

The original post: /r/datahoarder by /u/MilkSheikh007 on 2024-09-07 15:56:13.

Hello, seeking opinion on an SSD related topic.

I've done some research and noticed that some SSDs have a 200GB or more pSLC cache on a 1TB SSD m.2 drive but later on the consistent speed of seq writing drops by a lot in the mid 1000s.

My question is, how do you see this change? Some SSDs such as from Samsung or Kioxia have a smaller cache but their speeds don't drops as much relatively to competition and therefore can maintain a much higher sustained speed later on thoughout controlled benchmark tests.

Do you like the modern way of dictating SSD performance by allowing it to wield massive caches or do you think the old ways, such as that of Samsung with smaller cache but greater sustained speeds is the way to go for durability/longevity, overall usage smooth experience?

Might contribute to my SSD purchasing decision.

Bonus question. Thought of it just now:

The Samsung 970 EVO Plus is very old, released in 2019. Is it worth the purchase in 2024?

The original post: /r/datahoarder by /u/mushleap on 2024-09-07 14:53:55.

I need some external storage for old photos, documents, digital artwork & music/movie projects etc. I'd like to be able to access these files at anytime too, if I want to edit them or transfer them

I've only ever used USB sticks for this job before, but I've lost many files that way, I never realised they they were notoriously unreliable. I tried to research what to use on here but I keep seeing people saying things I really have no clue about & never heard of before (RAIDs?? Nas??), I feel that stuff is too complex for what I want. I don't think I'd need more than 1TB storage, but I do want a regular USB and a USB-c connection (I use my macbook as my main computer but I want to get a pc in the future, so the storage needs to be compatible with both). I'm looking to spend £60 or under

I'm thinking a ssd or hhd, but I'm not sure which is appropriate for my need? Can anyone advise me?

BTW I will be doubling up on storage! I use onedrive for my files too, but my Internet connection is insanely slow so backing up files on onedrive can take many hours for only a handful of files

The original post: /r/datahoarder by /u/joetaxpayer on 2024-09-07 14:19:48.

I've started to buy a few drives from Server Part Deals, as I have NAS with 2 drive redundancy (Synology SHR2) and decided to try them.

First couple drives had 40K+ hours. Running for 3 months now, no issue.

Now, I just got in 2 Toshibas, 16TB, MD08ACA16TR and it's a mystery.

The part number doesn't show in a search except for this seller. Toshiba rep relied to my emails quickly. They don't recognize the number.

But, more strange to me? They both show 2 hours use. May '24 date codes.

Now, I'm just curious - the label says "Refurbished" on it. With no usage, I trust these were just some type of open box item that could be sold as new, so they relabled it? Happy with this purchase, just very confused.

The original post: /r/datahoarder by /u/dcs577 on 2024-09-07 14:03:37.

Confession: I’m a digital movie hoarder and an idiot when it comes to tech so I’m still stuck many years behind.

Current setup: I’ve been using this setup without much complication for several years but it is breaking down. I have an 18TB drive (only half full) that stores all my data. I have several smaller drives that are 3 - 5TB that back up all the data. I use these to plug into a blu ray player so I can watch the files on my TV. As I obtain new files, I have to plug and unplug these devices to my computer and transfer the files to both the 18TB drive and the corresponding smaller drive.

This is obviously a hassle and takes up more time than it should.

What I’ve tried: I got a new router with a usb input. The 18TB drive is too large for it but the smaller drives can be accessed from it. This at least saves me from plugging/unplugging one drive. The problem is, my Blu ray player struggles to access that drive over the network so I can’t play the files directly. It may be an issue with the Blu Ray player or the fact that they are in different rooms. The Roku in the same room as the router seems to work fine with it.

I’ve tried using a small media player device. It seems to have trouble playing a number of the files.

I also tried playing the files using my computer as the media server. It works but the videos lose connection a few times during one movie. Either the Blu ray player sucks for this or the internet isn’t good enough. It’s a fiber internet with 300mbps.

My TV does not have a usb input so I can’t currently go directly to it. The blu ray player can’t handle the 18TB drive being plugged in directly either.

What I Want: I’m hoping for a relatively easy, streamlined, idiot proof solution that allows me to keep the big 18TB drive in one place as my main drive and to view videos on the TV via a wired HDMI connection. At the moment, I don’t want to invest in a bunch of new drives so I’d like to keep using the ones I have.

What do you all recommend? Is NAS or a mini PC better? Or something else? I’m not gaming. I just want to be able to watch movies on my TV but all the options seem overwhelming and more complicated than it should be to do that simple task. Any guidance is appreciated.

The original post: /r/datahoarder by /u/Will_and_Worried on 2024-09-07 12:10:34.

As the title says, I’m cloning data from an old drive to a new drive and this is my first drive cloner. The progress reset at least twice that I’ve noticed and as of typing it’s been about 14 hours since I began. Neither of the drives had any bad sectors and both are the same size and manufacturer. As I speak it’s back blinking at the 75% light, creeping back up to the 75% light faster than it took to reach the first time.

The dock is an Inateck SA02003. So I’m trying to figure out since the manual isn’t the least bit helpful in this what’s going on. Is this something that tends to happen with drive cloners and it’s working as intended or is something going wrong here and if so, what’s at fault and how would I go about fixing it?

The original post: /r/datahoarder by /u/Xandania on 2024-09-07 11:05:25.

Hello, fellow Hoarders,

I have a smallish problem I'd like your advice about:

I got all my hoarded data (mainly video and audio files) stored on a huge array of external drives, fed to the lone PC via a tree of USB hubs.

As management of this turns my old Windows workhorse too slow for my liking as well as cluttering my space, I am looking for a more compact way to store those drives while giving over management to another machine.

So far I've oogled large PC cases (even considered welding my own) for a solution with a regular Windows home license and at least two SATA extension cards - and a smallish rack server with 24 hdd slots.

While the first option seems more along my competence lines as a PC-tinkerer since the early 90s, the server solution looks more efficient in both spacial and energy requirements.

Usecase: One machine for storing data on many hdds to allow access for one other machine on the same LAN.

How would you choose? And please explain why to this middle-aged nerd .

The original post: /r/datahoarder by /u/PrimeYeti1 on 2024-09-07 10:39:48.

I recently got a WD MyBook (8TB) to store some disk images and ripped DVDs on. Decided to make the disk image with CloneZilla and when doing this I thought I’d make a Linux image and a Windows image. The way my drives are I have a 2TB drive that’s solely windows and then a 1TB drive that’s 50:50 Linux and Windows.

I then had the thought, what’s the point of splitting it this way? Why not just make 2 disk images one for the 1TB and one for the 2TB? Since if a drive fails I’m going to need to restore the whole drive.

So my question is, generally, do partitions fail so that only a single partition needs restoring? My idea is just that if anything could fail it’s going to be the whole drive itself rather than just a single partition on the drive. Could someone confirm please?

The original post: /r/datahoarder by /u/raw_onions_are_good on 2024-09-07 09:36:17.

I'm planning on making notes for college using rnote, a program that allows the use of pen tablets.

Thats all good but there is no cloud storage so I have to store the notes locally. What is the best way to do this so I don't lose my notes?

My current plan is to store it on a hard drive, and a USB stick to carry around

The original post: /r/datahoarder by /u/bendy27893 on 2024-09-07 08:36:35.

1 terrabyte preferably im mainly going to use it for storing games and music so one that has decent file transfer speed would be nice dosent have to be pretty just usable ive already had a bit of a look but didint find much

The original post: /r/datahoarder by /u/Y2K_350 on 2024-09-07 08:28:49.

Hey everyone,

I recently purchased 6 22tb SAS drives. All, but 1 of them show up as incompatible according to 3 different HBAs. All HBAs are flashed to IT mode. All 6 drives normally appear in the operating system, but only one of them appears with a file size of 22tb, the rest show 0 bytes and cannot be formatted or initialized. The 6 drives all came in one shipment, they are the same model number, and were even all manufactured on the same day according to the labels, they also run the same firmware.

Is there any way I can save these 5 drives or should I consider them a total loss?

The original post: /r/datahoarder by /u/sacnoth0 on 2024-09-07 08:22:39.

I recently got access to a 1 TiB OneDrive for Business. Unfortunately the administrator of the organization restricted third party apps from accessing the storage, so I can't upload to it directly via rclone - Or at least I didn't figure out how. I left the clientID empty but it still said I needed permission from the administrator to log in to the " " app (didn't display a name, probably due to the empty clientID).

I can connect to it via the OneDrive Windows app, but wanted to upload from a Linux machine.

Do you know any ways how to easily upload to a OneDrive for Business that restricts the use of third party apps?

The original post: /r/datahoarder by /u/YOUR_TRIGGER on 2024-09-07 06:52:50.

and it wasn't from mine.

i went to install on steam an F1 game from 2011. i guarantee i could've, at that time, grabbed this game that worked offline. probably did, probably why i bought it.

but i bought that shit. and now it doesn't work. it's not like i don't know about stuff, i can boot up dos boxes to play games from when i was born. but apparently 2011 was so far away. jazz fingers. i'm pretty sure it's intentionally locked down.

back stuff up. if you like it, take it and lock it away.

The original post: /r/datahoarder by /u/Random7872 on 2024-09-07 06:03:22.

If I backup data and don't touch it for years,, will the magnetic field of the HDD fade and make the data unreadeble?

Must I copy data from one disk to another every X years to 'refresh' the magnetic field?

The original post: /r/datahoarder by /u/retyredIT on 2024-09-07 04:51:45.

The original post: /r/datahoarder by /u/Prog47 on 2024-09-07 02:30:24.

Anyone have a case like the following:

https://www.ebay.com/itm/374094124539?_nkw=supermicro+case&epid=1840946011&itmmeta=01J752188TF39QM5EBNW4DS0AS&hash=item5719bf55fb:g:In0AAOSwntVmoZJY&itmprp=enc%3AAQAJAAAA0HoV3kP08IDx%2BKZ9MfhVJKmpsdyJAt%2FQ8OmGiXLhN5C7AAACpwm8TwYKgIUaj%2F31CYWv%2F20%2Fet4cRb0q5hbLHFVYwBr4OBKWNv612PuGyiPOApAh%2FhEXrb1hfl4aYG4%2B49MTZyzFswcc3IwcMbNLYZ0hMONps3Ca00532TWA9Fiy2nQxD3O%2FiUmOPrMcDwwRJRo6Zdyl8X7n2WFrx1A2JcRoQIUByNm%2BVZJB7K80wjjcqiPW5B%2FVwG3zWdNsjojJYFmnuszWbc6Qfvzy6BOSMnc%3D%7Ctkp%3ABk9SR8CEhaK5ZA&edge=0

?

I already need to replace my server i use for virtualization so why not use a case that allows me future expandability in terms of storage? I will be running proxmox. Maybe i can virtualize unraid &/or truenas scale. They are priced right around $400. Either that or buy one with a old cpu/memory for a temp solution. They case does seem like its built very well

They look like really good cases. My concern probably is power consumption (but i wouldn't think the case would add that much) & of course noise. Granted it will be in the basement but i don't want to hear a rocket engine every time im in the basement (& i'm sure i will get wife complaints).

The other option i'm thinking of is HL15 from 45 drives but then i'm going to be spending a little more than 2x for the case (granted it will be quite a bit quieter).

Opinions?

The original post: /r/datahoarder by /u/AllUCanEatDick on 2024-09-07 02:16:12.

Hey so after finding out Reddit only lets you have 1000 saved posts and then removes older ones I decided to get a copy of my data. Which I now have in my files but it’s just a bunch of links, are you saying I have to paste each link when I wanna see a saved post? I’m on my iPhone btw. Let me know an easier way to see them.

The original post: /r/datahoarder by /u/AshleyUncia on 2024-09-06 23:55:05.

The original post: /r/datahoarder by /u/Scott-Michaud on 2024-09-06 23:26:26.

Assuming that I will not just prune dumb files, what is a good method to optimize the following situation:

I personally have clumps of data (ex: old projects, etc.) that love tonnes (think millions) of tiny files.

I currently backup to the cloud + a couple external hard drives. Keeping incrementally up to date is fine, but I'm currently working on moving to new external drives (long story involving Ubuntu 24.04 and the old drives using NTFS, which is currently bugged out... plus it gave me self-justification to buy larger drives) and my file copy system looks like it'll take a week or two because all the tiny files push the transfer rate down to the tens of kilobytes per second. (When I hit the occasional large file, it jumps to ~150MB/s. I tried letting it go anyway; we're on Day 3 and still nowhere near complete.)

A lot of these clumps of files are irreplaceable, but unlikely to be opened more than once in like... 10 years.

My thought is to crush the entire folder into an archive format of some sort, so I'll have one (hundreds of gigabytes) file instead of millions of files totaling hundreds of gigabytes. (Much of it is just generated crap that I can delete, but... I don't want to, particularly because I've "oops I actually needed that" in the past.)

The cost of storing this is perfectly acceptable. Zero compression required. My main concern is that I don't want to try to open it in 2040 and find out the entire archive is dead.

My initial instinct is to use 7zip (the original PC is Windows) to dump these folders into .tar format, and delete the original folder. I know a little about the format, and it seems reasonable to me, but not enough to know if there's any edge cases where everything can come crumbling down.

Main questions:

1. Is there anything fundamentally stupid about the entire premise of what I'm saying?
2. Is uncompressed TAR about peak resilience? Or is there a better format?
3. Anything I can do to validate that the data is (initially) perfect before I delete the original?
4. Any other advice?

Thanks for your time and your consideration!