It's A Digital Disease!

The original post: /r/datahoarder by /u/vortec350 on 2024-07-18 00:20:27.

https://www.amazon.com/gp/product/B0D1WYD1DB/

I'm going to use this with two 1TB WD Red NAS SATA SSDs in mirrored RAID. Reason I want this is because it's cheap and has 2.5GbE. I already ordered it but as it seems like it'll take a week or so to ship, I can cancel the order if something else would be better for around the same price range?

Thanks.

The original post: /r/datahoarder by /u/thinvanilla on 2024-07-18 00:13:26.

Trying to wrap my head around the differences between RAID5 and RAID6. It floats around a lot that RAID5 is advised against, and there are always comments saying "it's ok in a 3 drive setup" etc. and that it's mostly not recommended for larger arrays.

I currently have a 4 bay NAS with 3 drives set to RAID5 (or SHR). I have an external drive for backups and setting up my offsite backup next week. If a drive starts to fail, my plan is to use the empty bay to copy everything from the dying drive, rather than performing a database rebuild.

Overall I'm not that concerned about dual parity for the meantime because ~~if a second drive dies that's my excuse to get a bigger setup~~ my hope is to catch the failing drive early, and I've got backups to fall back to. To be honest I think I'll have a bigger setup before I start seeing failures anyway.

However, something I've been trying to wrap my head around is data scrubbing. This looks at the data on the drives against the parity and checks for errors. If you have two parity drives, does that mean you have more accuracy during data scrubbing? Because now it has two points of reference?

Just making me wonder if I should consider filling the 4th bay and set to RAID6 (SHR2) for better data scrubbing.

The original post: /r/datahoarder by /u/DarkLucy on 2024-07-18 00:12:17.

Hello! I'm currently trying to backup about 1.5TB of data to an external drive using Veeam Agent free community edition. I noticed the speed of the backup is staying at about 25 MB/s now for an hour which seems very slow. Is this normal?

Mobo: ASUS ROG STRIX Z790-H

External: WD 5TB My Passport, Portable External Hard Drive - WDBPKJ0050BBK-WESN

Have it plugged into one of the rear blue USB ports (USB 3.2 Gen 1)

Internal computer data is stored on SK Hynix Platinum P41 2TB PCIe NVMe Gen4 M.2

The original post: /r/datahoarder by /u/RChadwick777 on 2024-07-17 23:58:28.

Assuming the data you flash on to a MicroSD today won't be there in 10 years, does anyone know of an Android utility that will easily or automatically rewrite the contents of a MicroSD to restart the clock?

The original post: /r/datahoarder by /u/0xDEADFA1 on 2024-07-17 23:57:09.

The original post: /r/datahoarder by /u/glorpo on 2024-07-17 20:25:22.

I bought two 14TB Seagate EXOS X16's from ServerPartDeals because I heard refurb drives are good and cheap. I've only ever used external drives before. I had a hell of a time getting them to initialize - disk management constantly stopped responding, gave semaphore timeout errors etc., but eventually by plugging them in one at a time I was able to get them initialized and NTFS formatted. I copied some test files and checked SMART - both fine.

Ran HD Sentinel which someone recommended here. Immediately found hundreds of thousands of bad blocks. I was a bit alarmed, but the SMART data was still good, and I found this program may have some bugs related to this, so I tried disk-fill test: https://panthema.net/2013/disk-filltest/. It filled both drives completely and verified the contents after about a day and a half each which seems like a reasonable speed. After that I was satisfied they were good and started backing up files to them. They were fine for a couple weeks after that.

HOWEVER, today I had the return of the semaphore timeout, parameter is incorrect, disk management not responding nightmare. After switching USB ports (both are 3.0) they loaded up fine and the data seems to be safe. I switched back and got the same problem as before. Is this a case of the USB port failing? It doesn't seem to have problems with other use cases like mice, or even my smaller external drives.

I'm kind of terrified, because I don't want to be in a two-is-none situation. I haven't yet deleted anything from my previous full drives that I copied to these new ones, so I currently have four copies of everything. I'm thinking of buying a third, different model of similar capacity just for peace of mind, but I'm just really not 110% confident these drives are good. Is there some way I could test the USB port to definitively prove that THAT is the issue? I don't want to end up getting a new computer and end up being unable to plug them into ANY of its ports.

The original post: /r/datahoarder by /u/nsoifer on 2024-07-17 20:50:18.

Could someone recommend a model that is strictly for Plex and arr/kometa containers?

I'm currently using a DS1522+, but it's struggling with transcoding and remote using. I really like my set up, but whenever I try to transcode something or play heavy 4K movies remotely, it either struggles or just doesn't work.

Currently running:

• 5x16 TB
• 3x20 TB
• 2x22 TB
• 500 GB M.2 SSD (cache)
• 400 GB M.2 SSD (storage for containers)

Is there a model that can be expanded to at least 15 bays total, has SSD support (preferably NVMe M.2), has SHR, and can properly transcode?

The original post: /r/datahoarder by /u/F_Kal on 2024-07-17 20:03:39.

My M1 mac's internal drive is a fast but small SSD (500GB, R:2500MB/s W:1500MB/s). I have 10TB of external HDDs but those are not fast enough for my "working" set of photo libraries, VMs and LLMs. I need a speedy 2TB ssd that will be running 24/7 plugged to my imac. Are Samsung T7 or Crucial X9 the best options I have in terms of reliability, speed and price (~140€)? Is one better than the other? Or should I go for an internal drive inside an enclosure?

The original post: /r/datahoarder by /u/nukem2k5 on 2024-07-17 19:30:17.

I want to convert my unRAID server back to a snapRAID + Drivepool scheme. With Windows 10 reaching end of support next year, I figure I'll go with Windows 11.

Are there any major incompatibilities or issues I need to be aware of with either software?

The original post: /r/datahoarder by /u/Yukinoooo on 2024-07-17 18:43:14.

I'm looking for a High-End 2230 NVMe SSD for my handheld PC gaming, which high-end model do you recommend under 120-100 bucks ?

The original post: /r/datahoarder by /u/Public_Cress6584 on 2024-07-17 18:18:23.

I am looking for an SSD that can hold a lot of files/data ect as I am about to go to university. And I'm trying to find one now especially with it being prime day. I don't know a lot about this kind of thing, but I have seen people recommend Samsung as a reliable drive and I want it to be compatible with both Mac and windows which it does. I become very attached to keeping files so it is really important I can rely on it. My question is with a lot of use, will the shield's rubberised material make it run hotter and therefore damage it? Should I even get the t7 or would you recommend an entirely different option?

Edit: Since looking at more options I have also seen people recommend LaCie rugged SSD's is that a good option too?

Thanks for the help in advance 👍🏼

The original post: /r/datahoarder by /u/tmaccd on 2024-07-17 16:42:58.

About 13 years ago SanDisk released a product called "Memory Vault", which claims to preserve data for up to 100 years.

https://mp3support.sandisk.com/downloads/um/memoryvault-qsg.pdf

Now, almost 13 years has passed, does anyone still have this little device? What did you use it for and is the data still intact?

What do you think of this product now? Useful? Gimmick?

https://preview.redd.it/ej9c0uqfx3dd1.jpg?width=500&format=pjpg&auto=webp&s=9b4c8381983a04507934c3c2ab3a02d13529d925

The original post: /r/datahoarder by /u/xkcx123 on 2024-07-17 16:02:18.

I’m looking for deals on SSD’s of 4 TB or above this prime day deals ?

Doesn’t matter if they are PCIE, NVME, or SATA.

The original post: /r/datahoarder by /u/Logical-Target8131 on 2024-07-17 15:56:33.

Hi data wizards

Adding to the title, I'm looking to build my own home NAS and already got a 4TB WD Red NAS drive.

I have 2 options

1. Odroid HC-4 8GB, which costs more than 120$ (usd) here in my country
2. (Renewed excellent) Mini PC Intel i3-6100T 6th gen processor with 3.2 GHz, 8 GB DDR4 RAM, 256 GB SSD for less than 100$

Which one should I go for? Other suggestions are also welcome if you don't mind sharing

The original post: /r/datahoarder by /u/KabegamiAkuma on 2024-07-17 14:09:56.

Hello, i am here to ask something, how i can download all elderscrolls.fandom.com include other language and view it offline? I have tried with wget and its command:

wget -m -E -k -K -p elderscrolls.fandom.com

But the links between the pages dont seem to be created, someone can help me please?

The original post: /r/datahoarder by /u/baksys on 2024-07-17 14:06:04.

Hellow fellow hoarders! I was trying to download a blob video following many guides online and trying many Chrome plugins with no luck. Even recorders are failing to capture stream. Maybe you know how could I download this specific video? The video is after unskippable annoying ads, of course.

The original post: /r/datahoarder by /u/PlannedObsolescence_ on 2024-07-17 13:20:23.

The original post: /r/datahoarder by /u/xaocon on 2024-07-17 11:52:31.

I'm using yt-dlp to pull media right now but I'd like to start archiving it more effectively. I'm trying to find a library that would just sit on top of yt-dlp/youtube-dl that would keep details about the download in a database and provide some level of dedupe (like the archive function that exists but with a DB backend instead of a file). I wanted to build on that to do things like search across tags, titles, and descriptions as well as an almost duplicate finder.

Anyone know of such a library like that or even an OSS app that I could use as a bases?

The original post: /r/datahoarder by /u/joetaxpayer on 2024-07-17 10:48:30.

Server Part Deals has the 16TB Toshiba Enterprise drive for $210. Lowest I ever paid till now was $220, November, 2022. Since then, typical price has been $290.

New, not a refurb.

The original post: /r/datahoarder by /u/Sensitive_Most_1383 on 2024-07-17 10:21:41.

Hope this is okay to ask. My favorite game is Sims 3 and I’ve spent many months and hours pouring through archives to find rare and lost custom content items. I’ve got probably around 100 gigs, I’m not even sure but it’s upwards of 5k files.

Right now they’re all siting loose in one folder as individual .package files. Is there a way I can categorize these without having to do it one by one or did I shoot myself in the foot by not doing that as I was downloading?

Also is it worth it at all to compress them into a zip file? Thanks in advance.

The original post: /r/datahoarder by /u/TeaBagMeister on 2024-07-17 10:14:01.

I'm testing four 12TB 7200rpm HDDs with my Icy Box 5-bay USB 3.1 Gen2 enclosure on my UM790 Pro, and everything was good with the first test. It was going very fast, but once it got to 'Reading and comparing,' it started going very slow.

It looks like two of the drives are making progress faster than the other two. What's the issue here? Is it the HDDs, or is it the USB enclosure? The enclosure is a USB 3.1 Gen2, so it shouldn't be bottlenecking, right?

I don't want to stop the test or reset it since it has been running for 63 hours already, and I don't want to lose that progress. The command I ran is 'badblocks -b 4096 -c 65535 -wsv'

The original post: /r/datahoarder by /u/Strik3R on 2024-07-17 04:37:10.

Hi i have seen the Seagate BarraCuda 8TB, 5400RPM, 256MB cache (ST8000DM004) drive at a good price and was wondering if it was a decent option for my gaming library backups. I know this is SMR and CMR generally is a better pick especially for writing speeds., but speeds don't matter that much for me.

Usage description (no nas):

I plan to use it with an external usb rack to backup my gaming & modding archives (i generally end up keeping my gog games for example archived)

Generally i used to unzip the installation files on the HDD itself install and then delete the unziped files, if this is a problem on an SMR drive i might change this behavior (as in unzipping to another drive) though personally i'm not sure at this time.

And in a year or two i do plan to get a secondary drive to have another backup of this drive.

What are your thoughts ?

The original post: /r/datahoarder by /u/ControversialBent on 2024-07-17 09:20:54.

Tried following this post: https://www.reddit.com/r/DataHoarder/comments/17jqath/looking_for_help_saving_a_video_feed_from/

Web Dev Tools -> Network -> Media -> first URL (https://cdn.livestorm.co/uploads/media/file/a9337315-91ac-43ef-940f-147fbc5aa087/hls/...8e3d-b35a47eea40a.m3u8)

yt-dlp --referer "https://app.livestorm.co/" "https://cdn.livestorm.co/uploads/media/file/a93...087/hls/...8e3d-b35a47eea40a.m3u8" --no-part

Ended up getting the following error:

ERROR: [generic] Unable to download webpage: HTTP Error 403: Forbidden (caused by <HTTPError 403: Forbidden>)

The original post: /r/datahoarder by /u/KitchenRegion4609 on 2024-07-17 09:04:13.

Hi, could any1 advice me on how to do so and what equipment id need? The only thing i could find was that id need a capture card. The VHS player i have has only composite and SCRAT output. But i wanted to ask a few more people before proceding. Thanks in advance for your help

The original post: /r/datahoarder by /u/OliDouche on 2024-07-17 08:21:36.

The price is limited to two per cart. If you add a third, the price increases for the third drive. But you could add 2, purchase, then purchase two more.