It's A Digital Disease!

The original post: /r/datahoarder by /u/thekennysan on 2024-06-28 10:29:01.

Hi all,

I've been using a NAS and OneDrive but it's filling up fast. Yesterday I visited a colleague and be showed me his storage setup - basically a wall of numbered DVDs (not M Disks) and a folder with a text file for every DVD. He's been doing this since 2011 and vouches that he hasnt lost any data.

I know that scratches are big concern when it comes to optical disc's but assuming I can keep the discs clean and dust proof, is this really a good option to consider?

The original post: /r/datahoarder by /u/gofiend on 2024-06-28 06:30:34.

I'm setting up a simple USB-C DAS on a spare machine to work as a NAS. I've played with NAS systems before and had bad experiences when it's been pretty hard to recover files from a 10 year old NAS. I'd really like to optimize for recoverability first, and then of course speed. I'm currently working with two 14 TB spinning disks, but I might add one or two more in the future.

Assuming I go with something as simple as RAID-1, what's the best filesystem for maximum compatibility? Chances are if there is a real problem, I'll be trying to recover data on a PC or Mac.

I'm guessing exFAT is the safest bet, but of course there are advantages to a journaling file system. Do folks have a sense of what the speed difference between exFAT and EXT4 or something fancier would be assuming I'm mostly doing long duration static storage? Does it even matter if it's all accessed on 1 GB ethernet or slower wifi only?

The original post: /r/datahoarder by /u/HunterDude54 on 2024-06-28 05:54:11.

My second-worst nightmare just happened*. I have been using Startech 4-bay USB docking stations for about 8 years (actually I now have 3 of them). I cannot afford raid systems, and this has been good till now. I have over 16 external 3.5" HDDs, currently ranging from 4 to 16Tb. They all have a backup copy which I keep in a sealed case/box. I back them up after a few months collecting. Mostly movies, 1 drive of music and 1 of TV series. This is the 4-bay drive: Startech 4-Bay Hard Drive Docking Station Cat SDOCK4U33E. (Today's website specs are current, but are not the same as when I purchased them years ago).

This week I upgraded a number of 8Tb drives to 12s, and 4 of my 12Tbs to spanking new 16Tbs Seagate IronWolf Pro 16TB NAS, then I cloned each to a backup HDD - all good. But after that, I moved (not copied) many new files to some of the drives with the intention of backing them up a bit later in my usual fashion. Yesterday all was perfect.

Today, all 4 drives on the one 4-bay dock are simply dead. Chkdsk /f (Windows 10 Pro) seemed to run fine, but found 16k or so errors which it claimed to fix, but now the drives are each empty except one or two primary folders (empty) and one or two text files in the root. I've lost a drive or two before of course, but never before on a scale anything like this massive slaughter.

I would love advice on what may have happened! To reduce my future damage risk a bit. All I can imagine is that maybe the 4 x 16 Tb load was too much for the docking station, tho I can't figure why, as it seemed fine for a week. However, I do note that this happened after I installed the last 16Tb drive into the dock - which I only did yesterday. Yesterday all was fine, today 4 dead drives. Have I hit some limit on the Startech station? Was that last 16Tb drive somehow the straw that broke the camels' back? Could it be a bad batch of drives (although they were purchased at different time in 2 batches 4 months apart)? It certainly does not 'feel' like a regular HDD failure.

I would welcome suggestions on ways of moving forward. Noting that likely I won't go raid, since both the cost and the scale do not suit me. Would these Orico 5-bay docks be better, as they state they support 16Tb drives? ORICO 5-Bay Hard Drive Docking Station with Offline Cloning - SATA to USB 3 up to 90TB cat 6558US3-C

Meanwhile I can re-clone the lost 64Tb on those 4 HDDs, but I am afraid to take them out of their Aluminium Protection Box now! A lot was lost, maybe 4Tb of new stuff, but at least not most...

Advice and/or sympathy are welcome. Oh the life of a Data Hoarder can be a stressful one.

* [PS: my actual worst nightmare is a fire and losing the lot! Only about half of this archive is currently offsite. I think I might do something about that. For the backup drives I store them in 2 x Orico Aluminium 10 Bay Hard Drive Protection Box, but I have no idea how long those may last in a fire..]

The original post: /r/datahoarder by /u/pinelands1901 on 2024-06-28 02:17:38.

I'm in the process of downloading all of my photos from various cloud services to burn onto an M-DISC Blu-ray for long-term archiving.

My question: would organizing the photos by year into folders be advisable, or would that potentially lead to data corruption?

The original post: /r/datahoarder by /u/exasperateman on 2024-06-28 00:53:21.

Basically I have a list of .zip files I want to extract to a location on the computer but it's getting really annoying going through one by one. Is there some way I can use the list of filepaths and feed it to an archive extracter?

The original post: /r/datahoarder by /u/BEST8OY on 2024-06-27 20:09:14.

Hello

I have a lot of folders which each has a HTML file in it

The only option that I found that can download them (extracting those images' titles in each HTML file) is DownThemAll

But the problem is that I can't do that one by one and moving them to HTMLs respective folder. it just doesn't make sense :)

I tried some AI generated python script but one of them only download files based on their URL names and the other which uses Beautiful Soup misses some of the images.

Is Beautiful Soup the only option?!

https://preview.redd.it/ue611kg2669d1.png?width=1913&format=png&auto=webp&s=27f63779b69430f3e630c9bf3263876daeba4221

https://preview.redd.it/er3wx0rb769d1.png?width=1066&format=png&auto=webp&s=ab50a35826ad30196a51004e8fdf3c8d91ffbb1c

The original post: /r/datahoarder by /u/DarthLaters on 2024-06-27 19:32:37.

I have data I can't lose. I currently have it copied on:

Samsung SSD 1TB

WD HDD 4TB

Seagate HDD 4TB - stored at a separate location

1. I know nothing about storage, and bought the above because I read drives fail often (?)... and I'm terrified. At some point, statistically, multiple drives would become overkill

but I have no clue if that's 3 or 40. If money were no object, how many would you have? 2. I've seen people mention NAS & RAID. Is this something I can buy and use out of box? is it something I download? I DID search the web, but anything tech related is extremely daunting for me -- and every article assumed I knew basics. Any recs, explained in dumb-dumb language, is appreciated.

I know there are also cloud options, but they make me uncomfortable. Maybe that feeling isn't warranted, idk. Thanks!

The original post: /r/datahoarder by /u/xioking39 on 2024-06-27 19:31:57.

Hello,

Redirected here due to the plex sub being mostly about smaller storage systems. Also saw a couple posts about people using netapp systems and that being almost the "final phase" in a large setup. Ive outgrown my current syn100tb setup and use a dell sff pc for hosting plex. Looking for building advice while keeping in mind future expansion. I will be using this setup for Plex(20+users), PC backups, ISO storage, Photo storage, Basic file backups, security cam storage, and music storage.

Im thinking one of these options:

1. Netapp DS4246 paired with a Poweredge 1U/2U with XCpng or similar
2. Powerdge 730XD with truenas and then just adding addtl 730XD as needed
3. Netapp DS4246 with a small pc that has the needed expansion card for connections

Open to any other suggestions or advice as I expect to need over 1pb within the next year. Location - USA, Power - 120v.

The original post: /r/datahoarder by /u/Psychoshawarma on 2024-06-27 19:13:02.

First time trying JDownloader and trying to download a course from Oracle University. Tried to follow the instructions from u/LowCarbCracker in this post (if you see this, thank you so much mr. LowCarbCracker), but the mp4 is being downloaded without audio. Any solution or something I can try?

The original post: /r/datahoarder by /u/quietgui on 2024-06-27 15:01:31.

I borrowed Game of Thrones Season 2 from a friend and wanted to add it to my digital collection. There are only two episodes per disc but it took more than an hour to rip it…maybe because the disc was a little scratched. But holy moly even on my 24 inch monitor it looked awful. Way worse than any rips imI downloaded when the show was released even though the files are bigger. I thought I could cheap out on disc space for tv shows, sit coms are okish in dvd quality. Do you still enjoy watching DVDs? Is there an upscaling option?

The original post: /r/datahoarder by /u/HaxerOne on 2024-06-27 13:36:43.

Hey, as in topic. I got the UGREEN adapter from SATA III to USB-C and I try to access 2TB 3,5" HDD.

I know, that the "No Media" can happen due to too low power and that the bigger drives require 12V. However my adapter supports up to 3A on 5V and one HDD shows support for 0,75A on 5V and second HDD requires 0,435A on 5V.

Theoretically there is both the support for 5V and enough power via the port. Why is it not working though?

The original post: /r/datahoarder by /u/Average_Aoe_believer on 2024-06-27 10:59:35.

While trying to install a new windows i got two ssd's i accidentally formatted the wrong one using diskpart clean And i did installed windows on the other ssd The files that were on my accidentally formatted ssd are nearly 460Gb And i did not overwrite the disk or something it's still unallocated disk I tried many softwares And all of them find like only 3Gb and they are not even my files like they are swf files with lagre size While my disk used to have some recorded Audios and they are really important and most of them are wave type not even mp3 and theier maximum size cant be more than 20 mb but i found swf files for like 4 gb or 2gb idk what to do I tried disk drill and recuva and many tools Even i tried a Russian software called R.saver and it recovered to me 3 pictures (the only picture size is over 100gb and they are all the same pics and not even mine) I think that it's almost impossible to recover the data Please if there's anyone that can help just do it Those files aren't only mine but some of my family members i just hope i can recover them ...

The original post: /r/datahoarder by /u/Grimogtrix on 2024-06-27 07:24:24.

I am looking for recommendations for a 16tb+ drive (ideally available in the UK), that would work well inside of a desktop PC and be relatively quiet.

I can find numerous ‘enterprise’ drives that are 16tb such as the Seagate exos x18 or x20 or x24, and Toshiba MG08ACA16TE and WD Gold and WD Red, but I have not found any drives that are 16TB+ and designed to be used in desktops.

I understand that it’s possible to use the enterprise drives in a desktop PC, but that they vary in terms of how much they might have problems with temperature and noise?  I have a quiet case (Fractal Design R6) so that is a bit of a concern.

I’ve been searching this subreddit and others for info but felt I needed to post to ask as I’m having a data safety scare with my current drives that’s making me want to buy a new drive ASAP. Moving my old drives from my old PC to a new one has created some issues, and now my external hd that is back up is ALSO acting up which is horrible timing.

The original post: /r/datahoarder by /u/Immediate-Risk-7569 on 2024-06-27 18:44:04.

I set the spin down setting in windows 11 to never but the drive still spins down. Is there any way to prevent the drive from spinning down at all unless I eject?

The original post: /r/datahoarder by /u/CodeCreation on 2024-06-27 17:04:08.

howdy, keeping a long story short and apologies if this is the wrong subreddit, Im a surveyor who works in a department that rotates crews. Due to our high number of datasets (drone based, lidar etc) we are getting a server computer that will help render and process that data. It is linux based and will be running ubuntu. We have also been told by our company's IT team that our department will be kicked off of our company's network drives due to the fact that since I started we have maxed them out several times. So I am also trying to build this server with the ability to run an in office nas. I am fairly computer literate and feel confident I can get a solution working but I also haven't touched linux distros since college. Id like to see if any of you fine folks have suggestions on how to build or heck even buy a solution that will be rock solid for a local network storage solution that can be ran on the same server. We are specing out a top model dell precision or poweredge unit (corporate mandates require us to go dell only), we have yet to decide. But it needs to be as set and forget as possible because most everyone else in the department is not computer literate and I cant be 24/7 IT support haha. Just for reference we create about 20-80 gigs of data per day, every day of the week. We try to keep that data reachable for at least 1.5-2 years(laziness is a factor here) then we have been offloading to external drives to save on space. Any advice on this would be super helpful.

The original post: /r/datahoarder by /u/EfficiencyFine3560 on 2024-06-27 16:57:19.

There is an album on Archive.org that I want to download. I am completely unable to purchase this album in a legal way as there are absolutely no stores selling it. Quite possibly the only evidence of its existence are its Discogs page (One actually sold in November of last year) and an Archive.org entry. The album on Archive.org is in FLAC format and the rip is fully logged, which is perfect, however when I go to download the album, it says:

Files marked with lock are not available for download. Files marked with lock are not available for download.

It also seems to be uploaded by one of their paid employees and not an individual so I don't know if contacting them is a viable option either. I'm not sure if I can post the link in the post, so If I can, I'll post it in the comments. Any help is appreciated.

The original post: /r/datahoarder by /u/Apptryiguess on 2024-06-27 16:27:37.

I'm at a point where i have too many drives to justify running them 24/7 365 days a year anymore. At this point its over 15$ a month just for the drives to idle... . I tried having my drives spin down in windows and those fuckers never stayed spun down for more then an hour or two. I tried EVERYTHING in windows to not get them to spin up and they still spin up randomly.

What OS can i run that would also run a plex media server for example that can keep my drives spun down until i access them? I don't mind if every 12 hours they spin up once or something, but certainly not every hour. Can anyone recommend anything easy to learn / set up? Thanks.

The original post: /r/datahoarder by /u/naterv on 2024-06-27 15:32:25.

Hey guys! I am in the middle of migrating 200+ terabytes of data from dropbox to box. Me trying to get this done as fast as possible thought it would be a good idea to spin up a azure VM with a 20TB HD and just download 20TB onto the VM and then Upload that 20TB to box. (using filezilla for this) But me being new to this stuff did not realize the charge for upload bandwidth would be so high. Basically $100 per terabyte going out of azure. Is there a better way I can do this? Maybe I can get a VM somewhere else that does not have such high egress fees? Thank you for your input!

The original post: /r/datahoarder by /u/FungiKingdom on 2024-06-27 14:27:37.

Hey all, I'm thinking about building a NAS for photo storage for a Lightroom catalog. I currently backup each year to 2TB sandisk portable drives and label them and toss in a fireproof safe. In addition to cloud storage of course.

I was going to buy a 4 bay Synology enclosure, and get a 2 pack of 12tb Red Plus drives from WD, then run this Raid 1.

My question is, can I add 2 more drives later and switch to Raid 5 or 10 pretty easily?

Or would it be a big undertaking switching all that data and cause myself days of headache to avoid spending an extra $500 right now? lol

The original post: /r/datahoarder by /u/ferdious_bossanova on 2024-06-27 14:16:20.

Hello all, I've got an old Dell Vostro 260s just sitting around collecting dust.

I'm curious what my options are and if it's even worth it to use it as a NAS, and if anybody else has attempted it before.

It's a tiny thing, but I could definitely fenangle some drives into it and I have RAM sitting around that I can install. It's sole purpose would literally just be to hold the media for my Emby server, and nothing more.

The original post: /r/datahoarder by /u/Vatican87 on 2024-06-27 12:09:56.

I have nearly 65TB of NAS storage but not as redundancy. How do you check for issues periodically if the drives are not on its way to die? Just so I can sort of figure I need to backup certain files before I lose everything.

I don’t have these drives setup as redundancy and realize I should…thinking about setting up my new UGREEN 6-bay for it..

The original post: /r/datahoarder by /u/watermeloans135 on 2024-06-27 11:19:52.

I wanted to get a NAS to store things like old pictures, videos, game highlights, etc; and also host a plex server or at least store tv shows/movies. Realistically I will probably only access it from my PC and maybe my iPad to watch a few shows. This might be a dumb reason, but one upside of a NAS is that I don't like the noise from hard drives (I only have SSDs in my PC), so since it's not in my room I'll never hear it. It would be nice to have around 20TB of usable storage

Would a NAS be appropriate in this scenario? I'm aware that NAS is not a backup, so I might keep like a 4TB external drive and back up the important stuff (probably ~1-2TB) once in a while.

Additionally, I've seen a lot of people warning against qnap because of its bad software and security. I've also seen a comment which said that as long as you follow best practices, their security is pretty much the same. So does QNAP vs syno vs asustor etc really matter for my use case? If possible, I would like to be able to access my NAS remotely, but if it's truly necessary I'm fine with just accessing it within the LAN.

And lastly, there is a lot discussion about transcoding, specs, etc which I'm really confused about. Currently I just play video files straight from my computer. If I'm going to use a plex server, and I want to play mostly 1080p x265 videos, and sometimes up to 2160p x265, will I have any issues with the specs of my NAS? I'm going to watch these videos from my PC and iPad (possibly TV in the future). For example, I was looking at the synology DS923+, and I've seen comments about its lack of an iGPU and bad transcoding performance.

The original post: /r/datahoarder by /u/Lamuks on 2024-06-27 10:25:46.

https://calis.delfi.lv/forums/ better known as Cālis.lv is about to shut down. While it has its bad moments( being basically an echo chamber for certain topics) it was a pretty good resource for parents and when searching for things on Google.

About closure - https://www.delfi.lv/life/56017202/tiklos/120032158/eras-beigas-tiek-slegts-popularais-gimenes-forums-calislv

How to better archive it? I feel like just running HTTrack wouldn't be enough.

Kinda would be great to make a static searchable copy.

The original post: /r/datahoarder by /u/XxCarco11xX on 2024-06-27 09:11:16.

The original post: /r/datahoarder by /u/kizza1234 on 2024-06-27 09:04:23.

Hi I have an issue where my NVME is only going into P3 idle and drawing approx 0.5w. Using it in a small mobile pc and it really is noticeable at drawing power. My SSD should consume about 50mw when in P4 mode.

I’d like to force the NVME drive into P4 idle mode instead of P3 which appears to be the case.

I am runnings Windows 11 too :)

Is there any down side to using P4? For me this drive will only be recording video sometimes so it’s not used for access all the time.

If possible I’d also like to force P1 active as well when in use as this should save about 20% more power when in use too.

Thanks so much everyone!