It's A Digital Disease!

The original post: /r/datahoarder by /u/Hakihiko on 2024-05-22 09:14:09.

Premise: early I tried to post in the qnap subreddit, but there isn't much movement there in this moment. So I take a chance to ask here, hoping someone can help me.

Hi,

I have a qnap TS-653A with a the firmware version 5.1.5.

Recently I switched from 5x6TB to 5x18TB using RAID 5. Following guides online, I expanded the pool and now in the specifications it tells me that I have a Capacity of 65.45TB, Allocated 64.21TB and Unallocated 1.24TB.

My DataVol1 (I have just a single volume), after the resize to increase the volume to the maximum possible size, has a Capacity of 62.99TB.

Is it normal to have 1.24TB more on the pool that I cannot use to increase further the capacity of my volume? Can I use it in any way?

Also, since today I used always a Thick volume. If I'll change to Thin, will I be able to use more space (aka that unallocated portion of the pool)?

Thank you

The original post: /r/datahoarder by /u/linbeg on 2024-05-22 08:21:26.

How do you guys select the terabyte HDD Storage that you guys use? Do you guys always buy new or are you OK with used? And if used are you worried about the driving breaking or what are the steps that you guys take to make sure that they used one will be ok and reliable? Would love to get y’all’s input !

The original post: /r/datahoarder by /u/reddit_faa7777 on 2024-05-22 08:09:42.

Out of all the software raids, which ones allow having 3 (or maybe 4) parity drives, amongst like 16+ drives?

I'm thinking of doing this on Windows 11. I won't be using Linux as it's easier installing my VPN on Windows.

I'm not a huge fan of Snapraid because..... when doing important tasks I like to use a GUI.

The original post: /r/datahoarder by /u/Cody112233X on 2024-05-22 04:36:24.

So I currently have the HBA LSI Logic SAS9211-8I and have decided to buy more drives 16 in total I was wondering should i just buy an SAS expander like the Intel RES2SV240 or should I just buy the HBA LSI 9300-16I The HBA card is suppose to come in It mode already I think I would need to update the firmware of the SAS expander. What would be the better option most of the drives are exos 20 tb on Truenas scale I dont know if that makes a difference. Thank for the Input.

The original post: /r/datahoarder by /u/AntarcticNightingale on 2024-05-22 01:24:33.

I was looking at the SSD I bought last year and found them generally increased from the past year by almost $100. What caused this? Just curious.

https://camelcamelcamel.com/product/B09VLJ7VBM

https://camelcamelcamel.com/product/B0BHZQGN26

The original post: /r/datahoarder by /u/Streetamp_Lamoose on 2024-05-22 00:20:51.

I'm pretty new to using larger drive arrays and this seemed like the kind of place where people have things figured out. My apologies if this is basic knowledge, but my internet searching didn't seem to reveal a consensus.

I have a Mac Studio that I use as my main machine with 14+ Tb (out of 36Tb total) of mostly RAW photos stored on a 4-Bay OWC Thunderbay enclosure (Raid 5 via SoftRaid). This enclosure is directly connected to the mac via a Thunderbolt 3 (type-C connector) to the Mac. What drives me crazy is that, for reasons unknown to me, all day everyday, the drives seem to be spinning up, spinning down, spinning up, spinning down. Rest for 2 minutes, then spin up again and down again. I had been sleeping the Mac and allowing it to sleep my disks, but no matter what settings I tried it always woke from sleep about every 5 minutes, and would spin up the drive array, only to immediately go back to sleep and deactivate them. After about 2 years of this, My Hitachi drives eventually had catastrophic failures, and corrupted HFS+ volumes. I was able to recover most of the data from various backup schemes. I decided to replace the 4 drives with Segate Datacenter Exos Enterprise drives, thinking that I would change my approach and never allow the mac to sleep (just the displays). I hoped this would mean that the drives would stay powered up and always spinning, so hopefully avoiding the massive wear and tear I was getting before through constant power cycling and mechanical acceleration. My plan seems to be failing. I never sleep the Mac, and I've tried every setting I can find in the UI menus. Even if I haven't touched the machine in days, it is still spinning up, spinning down, spinning up, spinning down every minute or so. And to make matters worse, these Enterprise drives are LOUD. My poor daughter, who tries to sleep in the room next to my computer can hear the drives all night "Growling" at her, crunching, and spasming and spinning loudly, even when I haven't asked to access the volumes in days. I know modern OS'es run things in the background, like indexing, Time Machine, search optimization, caching stuff, etc. But is it really so constant? And why can't I seem to prevent the drives from ever turning off, which I assume (power waste aside) would be better for the health of the drives?

I just want to have a large Raid 5 drive directly connected to my desktop machine, with a fast connection for things like 8k video editing, and not feel like the drives are constantly power cycling themselves into an early grave. I've got to be missing something obvious here...

The original post: /r/datahoarder by /u/MerakiSpes on 2024-05-21 23:35:37.

It was an English cover of Signal from 91 Days. There were two high quality version, however, one of them got deleted. I cannot remember the name of the channel nor the URL. Is there anyway to still find it?

The original post: /r/datahoarder by /u/Educational_Tap4663 on 2024-05-21 23:00:45.

I’m planning on shucking a group of external hard drives to use in a homelab server I’m building. When you get a new, used, or refurbished hard drive, what are you go-to commands, tools, or processes to assess its health and performance? I’ve found several software applications, but I thought the experts of DataHoarder would know best. Cheers

The original post: /r/datahoarder by /u/big-sugoi on 2024-05-21 22:22:56.

I've got 18 years of unorganized backups that I'm trying to sift through (deleting 95+% of it all). A lot of folders have 2-4 duplicates in bizarre completely different directories, usually hastily backed up without care when reinstalling windows every few years. Sometimes 1 duplicate was partially sifted through to clean up.

Please god what do I do to make this easier. I don't want automated deletion I wanna do that part myself.

The original post: /r/datahoarder by /u/Tsusai on 2024-05-21 22:22:16.

Since a Drivepool pool doesn't support VSS, how are you backing up your data?

I've currently spun up a Veeam B&R VM (for synthetic full), backing up the individual volumes (can't do file backup), but the incrementals in the past 3 days since it was setup have been oddly high for not adding any data to the volumes (30-60GB).

I've pondered using my licensed copy of macrium to perform synthetic file-based incrementals (complains about VSS but it carries on), but I wonder what everyone else with Drivepool does

Edit: I currently have Crashplan as a online backup. This would be for an offsite in the same city setup (currently using Truenas & Tailscale)

The original post: /r/datahoarder by /u/FearlessENT33 on 2024-05-21 22:12:03.

i currently have a server running omv, with a zfs pool with a 4tb and 2x 2tb, for a total of 8tb however there is no parity or backup so if a drive fails it all goes kaput.

which means replacing- i want to upgrade my storage and have a better solution for potential drive failures, while potentially being expandable in the future. most of my data is movies / tv / music that can be reacquired, critical data is small and is backed up.

my budget isn’t massive, i’ve only just started working full time, so have potentially been looking at 3x 8tb drives in a raid-z1 array, for 16tb useable. being able to add in another drive in the future would also be good, and i think raidz1 would allow this, but hopefully by that point i can just afford a completely new server.

is this a good plan? or would there be a better array i could do? any advice would be much appreciated, thanks

The original post: /r/datahoarder by /u/CodeJBDA on 2024-05-21 21:42:18.

Hi All,

I am moving my whole server from a windows 11 base to unRaid.

I am currently using the program call drivepool to pool my 8hdds together so that Plex can look at one location. My worry is that when had to reinstall windows I had a ton of issues with ownership of the files. I am hoping to avoid that when going to unraid. Any thoughts?

The original post: /r/datahoarder by /u/pointthinker on 2024-05-21 20:58:10.

New here so, I hope this is OK to post.

I had a 3 TB WD My Book external HD fail. Smooth book like front. I'd like to swap it out. Does anyone know how to open this mystery case? Also, can I put in a bigger one, maybe a 5 TB? If so, this is for back up only. Which one should I get?

If case opening is not possible, I am open for suggestions for a USB C or A replacement external HD for a Mac mini M1. Probably not Seagate… bad luck with those. Thanks

The original post: /r/datahoarder by /u/SaarN on 2024-05-21 19:44:57.

I bought this drive last year because it was on sale and came with 5 years of warranty (and they're way cheaper now due to the bad rep), and I've just found out it has HW issues.

Although WD website states that my drive's firmware doesn't need to be updated, I've seen people complaining about losing data while using up-to-date drives.

How should I tackle this? It's supposed to be a portable backup drive - but it's totally worthless if I can't trust it to keep my files safe.

I thought of testing the drive before putting it into actual use. Like fill it up a few times and then formatting - over and over.

I don't want to kill it by exceeding the writes\reads limits, but to make it sweat a bit and check whether it's trustworthy to be used as a.. portable drive.

What do you guys think? Any suggestions?

The original post: /r/datahoarder by /u/Skidbladmir on 2024-05-21 19:22:59.

So I know that in order for it to be played on common DVD players the video needs to be encoded in a specific format (with a max 720p resolution) but if I just want the video to be played on normal PCs will that allow me to burn a high resolution video onto the disk?

The original post: /r/datahoarder by /u/KaleMercer on 2024-05-21 18:50:45.

I have a massive collection of movies, music, TV shows, and assorted disc-based media. There is little to no resale values so I'm not even interested in trying, But at the same time I'm not just going to chuck them in the trash is that would just be wasteful And I paid for these.

Looking for suggestions, opinions, and or recommendations for organization/ storage of the discs of themselves. I want to get them out of their cases as they take up a massive amount of space.

I was thinking about just getting one of the large disks cases but was wondering if there was anything more interesting?

The original post: /r/datahoarder by /u/McKing on 2024-05-21 17:46:08.

I am buing a QNAP TS-664-8G with 2x20tb seagate pro hdds. The plan is to add more storage in a few years. What is the best raid configuration for my nas?

I will backup all the important data, so I would only lose movies/tv shows that I can redownload.

I am now realizing that raid 5 might be the best option to have some redundancy. But it requires 3 hdds, am I screwed and have to get a 3rd 20tb one? And I can extend with new hdds without issues later?

The original post: /r/datahoarder by /u/Liizam on 2024-05-21 17:30:39.

Hi there, I’m new to data hoarding. I’ve noticed some of the design guides and other useful info disappearing from the internet and being places behind paid pdfs sites.

I would love to connect to other engineers on here to see what we can do. I have a pile of knowledge I’ve been collection throughout the years.

The original post: /r/datahoarder by /u/theseawoof on 2024-05-21 16:58:51.

Noticed that these drives tend to be the ones that easily have up to 24tb or so. I need a large HDD of around 20-24tb to hold my music and video software, VSTs, samples, video footage and assets, etc. Right now my case is maxed out with HDDs and I've had two consumer Seagate drives fail within recent years. I am willing to spend the ~$500 for one drive of high capacity if there is no downside.

Someone recommended WD Purple, saying that surveillance drives hold up to constant usage, but someone else mentioned that they have a slightly lower read speed. What would you choose for something if high capacity and longevity that is going to hold up to usage and not just general storage?

The original post: /r/datahoarder by /u/Culbrelai on 2024-05-21 15:30:32.

Alright so I don’t understand how this works.

8tb consumer nvme pcie4 m.2 ssds run the gamut from $850 to about $1100. Sabrent Rocket, Team, and so on.

They are all about 7000mbs sequential write, 6600 read.

8tb is the max size as of 2024 it seems.

There are also SATA ssds which also top out at 8tb and are massively slower than the NVME, but about $620 for a Samsung QVO 8tb.

Meanwhile

https://www.amazon.com/SOLIDIGM-D5-P5430-15-36-TB-Intensive/dp/B0C6BR89C2/ref=mp\_s\_a\_1\_8?crid=BBQOQ2PIYQDC&dib=eyJ2IjoiMSJ9.ylEfhDF9TJGI\_8EwgLEBHUXoDzf17amHeqJMISzMk2x7tf7hXg1PgheTCstANtyVpEAD28qRj\_TYx1CvOTh1hZbsgSteo1rgvqG8UQugG6-wnRrhgmph4dr-4AxHVAP6ebCn0J4ZQ83fvJcw2ZFnLBcaagyvJ\_amnEjwjrB\_Jszlx1cPmEOZmVoXaHjaUgaY839fH40SQWInIifesfAEag.o2h7SYjhTQoKgyvfpAGEtn7Mu2zDsfs4Gn3XrXFZKfQ&dib\_tag=se&keywords=Solidigm&qid=1716304607&sprefix=solidigm%2Caps%2C115&sr=8-8

This enterprise drive is double the capacity of the sabrent, for $1500 instead of the $2200 you’d need in m.2 to match. Half as fast in writes. Would take one less m.2 slot than the dual m.2 solution and therefore more lanes could be used elsewhere. Would need a relatively cheap m.2/u.2 adapter. Has higher durability ratings and longer warranties than the consumer options.

Why are high capacity SSDs only offered to enterprises? I don’t get it. Is there no consumer demand for SSDs greater than 8tb? What’s the catch? I’m close to just buying one of these and replacing 3 m.2 steam game drives with it.

The original post: /r/datahoarder by /u/TRUE_BIT on 2024-05-21 15:03:53.

I have approx 6k DVDs that need the raw files extracted from them. These aren't movies, just acting as storage media.

They will be transferred locally or to a network share.

I was thinking about getting multiple DVD to USB devices (5-8, depending on what would be most performant).

I feel like I would be at the mercy of the USB transfer speeds. I'm not sure if USB-C will be available.

Is there a better way to do this? Is there an optimal way to get the most out of my transfer speeds? A coworker suggested looking into leveraging VMs but I don't see how that would help.

The original post: /r/datahoarder by /u/password_too_short on 2024-05-21 14:07:54.

so i've amassed just over 30 usb 2.5" hard drives. i'm in my mid 30's and i use them to store basically every tv show and move i've ever watched.

and yep, i do re-watch stuff.

none of them have failed yet. except my music drive that makes a high pitched whine sometimes and lots of beeps...yeah i might replace that...but haven't yet.

for some reason i don't hoard games i've played though. i seem to value movies and tv and music more.

anyone else with a shelf of drives? what do you store?

The original post: /r/datahoarder by /u/kaczynski_machine on 2024-05-21 12:51:57.

Hi guys, I have recently gained an interest to download alal of wikipedia just in case. So i chose to use Kiwix using the .zim file from:

https://download.kiwix.org/zim/wikipedia/, en_all_maxi_2024-01.zim.

Downloading it is all fine and great, And in fact once it is downloaded on either of my computers (Yes, I tried on both my laptop and on my desktop.) I am able to open it using Kiwix and read it.

But obviously I want to keep the zim file safe so I can have it ready at a moments notice without needing to download it every time... So I've tried to put it on my SSD.

SO I guess the issue I'm having is when I try to copy the .zim file onto my disk, it seemingly went fine with no obvious mistakes. But then I disconnect the external ssd from my Desktop and connect it to my laptop to open it there (my way of testing if it is being kept safe on the disk.) and everytime some specific new error shows up when I try to open it in Kiwix. Sometimes its outright corrupted, sometimes it's missing articles. Like putting it on the SSD corrupted the .zim file somehow. Which would be a bummer because this external ssd is new and works like a charm usually, its just somehow not working for this specific file.

A few notes:

I have already tried compressing the file into .7r or .zip. Same type of corruption occurs after interacting with the SSD.

The SSD: 1TB, connected to my computer using a usb-c to USB cable. it is external.

I already ran "chkdsk D: /f" for the disk to check for any bad sectors, but the program reported zero bad sectors and said everything is fine.

I have also tried to reformat the drive to both NTFS and exFat. Nothing works. I'm so dissapointed. And feel stupid. Please help me, thank you! Have a pleasant day.

The original post: /r/datahoarder by /u/leurs247 on 2024-05-21 12:04:34.

Hi all,

I have some important files (not much atm, about 5GB) I want to upload to a (secure) online storage (cheap if possible).

I already have the data on my local machine (macbook pro) and an external harddrive, but I want an online storage solution as well.

I have used aws S3 before (for my work) so I have some knowledge. I could make a bucket to store the data.

Is there any interesting (free) software I can use (on a mac) to backup some folders to s3. I have mountainduck on my laptop but only in trial.

Another possible solution is to create a bash script to upload specific folders to s3 (not necessarily aws, could also be digitalocean) on an regular basis. I could possibly make a script with rclone, is this a good usecase for this?

I could add a cronjob (like every sunday at 01AM) but my laptop is probably in sleep mode at that time, how can I create a script that runs at sunday 01AM OR when I first start my laptop after that time?

Thanks!

The original post: /r/datahoarder by /u/subtle on 2024-05-21 11:55:13.

Hello,

After my recent PC crashed, I bought a new Mac (my first). I have 4 external hard drives. Only one was set to exfat. My Mac can’t read the other 3 because they are fat32.

My question is, is there a safe way to convert from fat32 to exfat without losing any data on those hard drives using my new Mac?

Originally, I was thinking of just purchasing a new external hard drive and moving the fat32 files over to the new hard drive that’s formatted exfat. Then formatting the old drive to exfat and moving them back. (Using my PC at my work.)

But if there’s an easier way that’s safe, please let me know. Thanks in advance.