It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
7251
 
 
The original post: /r/datahoarder by /u/SnooPineapples6099 on 2024-08-20 05:05:45.

Curious if anyone went from Red Plus to Red Pros and noticed a significant noise jump. I'm currently using 2x8TB Red Plus and considering the 22TB Pros.

I've read the Pros are much louder due to spin rate. I know helium is a factor, too. The numbers below don't seem all that crazy so I'm wondering how bad it actually gets.

WD Red Plus 8TB: 30 dB (seek) / 27 dB (idle average)

WD Red Pro 22TB: 32 dB (seek) / 20 dB (idle average)

7252
 
 
The original post: /r/datahoarder by /u/DJboutit on 2024-08-20 04:35:03.

My computer is a HP Victus 15L here https://www.omen.com/us/en/desktops/victus-15l-amd.html#anchor=spec-anchor only upgrade I have made its I replace the video card with a PNY 4060 TI 16gb to use with Topaz Video AI. Here are the hds that are hooked up to my computer * 500gb Samsung EVO 860 boot drive running Windows 11 * 12TB WD * 4TB WD * 5TB SG * 12TB WD * 3TB WD * 14TB WD I just picked up today * 4TB WD * 2TB WD * 10TB WD

My 2nd computer that is just used run my internet radio station Phat Beats Radio * 500gb boot drive running Windows 11 * 6TB WD

Not hooked up to any computer they do not have 2 years of use left * 2TB WD * 2TB SG * 1TB HIT * 1.5 WD

7253
 
 
The original post: /r/datahoarder by /u/Master0fMuppets on 2024-08-20 03:46:22.

I searched the sub for a post asking for what I'm asking, but nothing seemed to quite fit my use case.

In short, I have a drive on my PC with a bunch of media that I'd like to be able to share with friends and family. Ideally, I'd like to host a service/server locally that users can access from anywhere via a web UI - ideally, I could create and manage accounts that they can sign in with and browse the contents of this drive.

  • I'd like to avoid the end users (many non-tech savvy family) having to install anything at all, hence why a service with a web UI is preferable. I'm starting to think hosting via SFTP and letting them log in through something like SFTPGo through their browser might be viable. Assuming a VPN would be completely necessary for this though
  • MFA is probably a must security wise, but if MFA can be avoided without too much of a compromise to security, it would make accessing it even easier for people who won't even know what MFA is (think aunts and stuff, I ain't gonna make them figure out using an authenticator)
  • I don't even need to segregate by directories, I'm perfectly fine just sharing the entire drive to everyone. It's all photos and videos I'd be happy with anybody seeing all of
  • I don't care about a complex setup so long as the actual user experience is as simple as can be
  • I'm on a Win11 PC, with an Eero mesh (also acting as the router), so network configurability is not an issue (static IPs, port forwarding etc won't be difficult)
  • If the most well-suited config here requires payment, I'll def pay. But free is obviously ideal

Any and all help is highly appreciated. For a lot of my family this will be like having access to a massive family photo album (I've collected pretty much all of my fams media and scanned/organized it) so this will be really really really meaningful for a lot of people.

Thank you all!

7254
 
 
The original post: /r/datahoarder by /u/Nomeru on 2024-08-19 23:50:34.

Hello, I'm looking for advice as I explore my options. Currently all my drives are kept my case and are aging, have no redundancy. Primary use is media storage. Reads may be frequent, but writes somewhat limited as I download/gather them.

Right now I'm leaning towards getting a 6-8bay enclosure, using SnapRAID for 2x parity drives and Drivepool (already own and use). This would be on windows.

What I'm eying currently:

Enclosure (really not sure about this): https://www.amazon.com/dp/B0CYC6YTV3?ref=emc_p_m_5_i_atc

Drives: https://www.newegg.com/p/2RC-02PD-00146?Item=9SIA5ADK744541

Any thoughts, input, or advice would be appreciated as I don't especially know what I'm doing in this area.

Thanks!

7255
 
 
The original post: /r/datahoarder by /u/ResponsibilitySafe47 on 2024-08-19 17:27:42.

Hello!

I’m looking for recommendations on a Mobo/CPU for a high-reliability TrueNAS build for storing irreplaceable family photos/videos. I’m looking for fast file transfer speeds (in the 50MB - 10GB file size range) and don’t plan to run any dockers (yet…). I will be using 6x 16TB Seagate Exos (SATA) drives in 3-way mirrors (for speed and reliability), to give me a total of 32TB of useful storage. I expect this system to last me 10 years.

General requirements:

-At least 1x 10GBe interface to my desktop (for photo viewing/editing) and 1x 1GBe to my home GBe network. Open to using a NIC, but ideally the Mobo would support 10GBe on its own.

-At least 8x SATA ports (for the 6x HDDs and 2x boot SSDs)

-M.2 interface for L2ARC (~512GB)

-At least 64GB ECC RAM (preferably not SODIMM or DDR5 to save on cost)

-Case will be either the Jonsbo N3 (Mini-ITX) or Yufu Seat 6-Bay (uATX)

-Low power draw highly preferred

-Mobo + CPU ideally under $500 combined

My top picks for Mobo are as follows:

  • ASRock E3C246D4U2-2T (uATX) - Affordable at ~$240, but the Xeon CPUs seem to be expensive and power hungry
  • ASRock E3C246D4I-2T (Mini-ITX) - Greater support for cheaper CPUs, but Mobo is hard to find
  • ASRock E3C256D4I-2T (Mini-ITX) - Greater support for cheaper CPUs, but Mobo is hard to find
  • ASRock EC266D2I-2T (Mini-ITX) - DDR5 RAM is expensive and Mobo is limited to 64GB

I’m a novice when it comes to selecting a Mobo/CPU combination, so any recommendations would be greatly appreciated!

7256
 
 
The original post: /r/datahoarder by /u/nucleardeathgod on 2024-08-19 22:35:12.

I have 4k video down loader and it doesn't offer the ability to download descriptions. Not sure how to do it on YT-DLP either. Can anyone offer advice?

7257
 
 
The original post: /r/datahoarder by /u/Atomfried_Fallout on 2024-08-19 21:17:06.

While I'm hoarding for some years now I finally got the time and money to making a backup of my movie collection on a second server with one 8TB hard drive that will serve as my parents media server, but copying to it at around 100 MiB/s for 2 hours by now the HDD got nearly too hot to touch and I couldn't find any info if they will throttle down to prevent overheating or if it's fine/not fine for them to get that hot.

So my question is if they can too hot just on their own?

Edit: The drive is basically in the open air right now but with no fan/airflow.

7258
 
 
The original post: /r/datahoarder by /u/SnooPineapples6099 on 2024-08-19 19:39:54.

I've got 2-bay NAS in my living room (sadly not my garage or non-existing basement). It has two-8T WD Red Plus drive. Noise is fine.

Need to beef up storage and I'm considering jumping to the WD22Ts. I know they spin at 7200 and I've heard the noise is quite the jump. I'm also potentially debating on switching to 4/6bay NAS and keeping everything under the Red Plus family.

Does anyone the db difference in terms going from an 8 to 22? Is the noise going to be really obnoxious?

7259
 
 
The original post: /r/datahoarder by /u/Mashic on 2024-08-19 19:15:25.

There are certain clubhouse rooms that are other channelse that I didn't create and want to get the audio of these rooms, any method to get them as sound files?

7260
 
 
The original post: /r/datahoarder by /u/Big_Little_Planet1 on 2024-08-19 19:14:54.

As the title suggests I want to get a file which is no longer obtainable through original means of downloading it from the websites it was originally uploaded to. I’m a complete rookie and have no idea what to do when I can’t just get a file from the website it was supposed to be obtainable from. If it helps then the file is a game file for a Casio graphing calculator like the CG-10/20/50 called Stock Exchange, I searched on all the websites it could’ve been uploaded to like Cemetech.net, Omnimanga.org and Ao3 and continued following through each gateway into another website only to find that the download was no longer hosted.

If this post violates rules which I have read then I apologise, I’m unsure whether this might break rules 8, 9 or 10 as I think it possibly might.

7261
 
 
The original post: /r/datahoarder by /u/justfindaway1 on 2024-08-19 17:48:52.

I've found some youtube video about some github script which then suggests to manually edit-add the "chat video" into each video, but I don't know if it's code you can trust nor if it's up to date, and it's time consuming.

How do you do it nowadays?

7262
 
 
The original post: /r/datahoarder by /u/cmdrmcgarrett on 2024-08-19 17:14:54.

I have 3 external Seagate drives that I use about 1-2x a month. I also have 4 small external drives <4tb that I use about the same.

I have a spare computer ( i5-3570k ) with 6 SATA ports. I was wondering if I should shuck the drives and install them into the case vs leaving them as-is. What would make the drives last longer? A lot of this info is no longer available online.

I am in a quantry as what to do.

7263
 
 
The original post: /r/datahoarder by /u/TTsegTT on 2024-08-19 16:55:22.

There are various posts about this/these Seagate external drives... Amazon references the "Desktop" STKP14000400 as "newer" than the "402" Expansion version (counter-intuitive) - this, from the Seagate store on Amazon. On the outside, both external drives look identical. I know there are examples of both the Exos and Iron Wolf Pro drives used in "the 14TB External Desktop/Expansion Seagate"... The price is just about the same.

Is there any knowledge of what may be different between these two external drive models? I'm half tempted to buy both and use a Disk Utility to identify the internal drives.

One tends to think newer is better with tech, but in recent years a lot of companies have focused on driving cost out of their products so I'm not immediately inclined to go for "newer". I currently have the "402" (older version) ordered and will be receiving tomorrow. Performance of either internal drive is similar, but the Iron Wolf Pro durability rating is only about 60% of the Exos. Supposedly, for 10TB and above those would be the only 2 options you would get with this Seagate External drive. In reality, either will work for me as they will host my Time Machine backup data from my Mac Studio (I'll need to reformat them). I saw some Costco posts of this external drive and that has even a different product code... but every Costco drive shucked was an Exos. I don't intend to shuck mine. BTW, Costco no longer is offering this external drive for sale on their website.

7264
 
 
The original post: /r/datahoarder by /u/TyrantGnome on 2024-08-19 15:59:38.

so im new to shucking though i have done it before with some old Xbox and external drives out of curiosity before. im interested in getting some 2.5 ssd externals and a external drive bay hub to use them in as my laptop could do with a bit more than the 2.5tb it has in it.

i was hoping to get something around the 5tb mark but i know nothing on what drives would be good or the best medium to use them. i know I'm after best gb to £. i I'm happy to have drives between 4 - 6tb but 5 is a good number.

currently using an old 8tb Seagate backup plus hub and 2 1tb external SSDs (1 2.5 and 1 nvme) any advice would be grand

7265
 
 
The original post: /r/datahoarder by /u/Lav0c on 2024-08-19 15:14:31.

The tl;dr lists what I need and want. Below are the options I've looked into and what their issues are. I have off-site backup, but that is for disaster recovery and not for drive failure.

Snapraid:

good:

  • stable
  • spins up only one drive when accessing a single file
  • 2+ parity drives supported
  • able to just chuck in another drive of any make/model/size (this is crucial)

bad:

  • not real-time
  • absolutely destroys resources when syncing or scrubbing (CPU, RAM and disk usage)

BTRFS:

good:

  • tons of cool features like automatic file de-duplication and storing changes as diffs (of a sort)
  • RAID 6-ish support
  • real-time parity calculation
  • real-time error checking and file repair (silently fixes bit rot when file is read and doesn't match checksum AND there is good parity data)

bad:

  • RAID 6 still has the write hole issue that apparently got fixed for RAID 5 (so it's not stable/reliable)
  • spins up all drives when accessing a single file

UNRAID:

good:

  • stable
  • 2 redundant drives supported
  • spins up only one drive when accessing a single file
  • add a drive of any size at any time

bad:

  • doesn't do checksums on read to inform you of bit rot (third party plugins can make this somewhat possible but it's disconcerting to say the least)
  • proprietary

ZFS:

good:

  • stable
  • 2+ drive redundancy
  • ability to throw in another drive (caveat later on)
  • real-time parity calculation
  • real-time error correction

bad:

  • spins up all drives when accessing a single file
  • if you add a drive to the array you can only use the capacity of the smallest drive (12TB 12TB 10TB 8TB would basically turn into 8TB 8TB 8TB 8TB for usability)

MDADM:

good:

  • stable
  • 2+ drive redundancy

bad:

  • same issues as ZFS

FlexRAID: dead


I've also seen some things on Ceph having a RAID 6 that can have mismatched drives added, but I don't have enough research into that.

From everything I know, my options are as follows.


BTRFS RAID 6

Accept that it doesn't have the most reliable/safest RAID 6 implementation and do my best with my current understanding, my decent scripting skill (limited linux knowledge), ChatGPT and pray to get 2 SSDs in RAID 1 for metadata and write scripts that monitor for things that could indicate a write hole could be present and fix it before doing anything else with the array AND make my own logs that I'll have to check and hope they are working properly.


Frankenstein by essentially writing my own software (MergerFS, BTRFS, PAR2, Snapraid, scripting hell)

Go full-crazy and write my own software that uses MergerFS, BTRFS for real-time integrity checks to trigger repairs with either PAR2 (file-level) or Snapraid (anything PAR2 can't fix) - as well as all its other bonuses (e.g. file de-dupe).


MergerFS + Snapraid

Settle for my current setup that is lacking/disappointing/frustrating


tl;dr

need:

  • to have a stable system with a minimum of 2 parity or redundant drives
  • ability to add drive of any size to array

would like:

  • real-time parity
  • silent error fixing
  • spin up one drive when accessing a single file

edit: misrepresented unraid by saying it spins up all drives (it doesn't)

7266
 
 
The original post: /r/datahoarder by /u/NXGZ on 2024-08-19 15:07:44.

Like a computer system with built-in redundancies, a study has revealed that brains use three different sets of neurons to store a single memory.

A new study now published in Science reveals that the memory for a specific experience is stored in multiple parallel “copies”. These are preserved for varying durations, modified to certain degrees, and sometimes deleted over time, report researchers at the University of Basel.

The team's work has been published in the journal: https://www.science.org/doi/10.1126/science.adk0997

7267
 
 
The original post: /r/datahoarder by /u/Plastic_Departure446 on 2024-08-19 13:17:53.

I'm looking to get a NAS primarily for Plex but also minecraft server potentially, mainly plex though, I've built up a chunky physical library and have been ripping the files to a NVME in an enclosure for a while, I'm after a NAS to take this to the next level, my budget is around £350 for everything except the HDDs, has anyone got any recommendations (Open to DIY if part recommendations come to mind) Thanks guys you're the best!

7268
 
 
The original post: /r/datahoarder by /u/bforbrucebforbrave on 2024-08-19 11:39:23.

I'm not sure what i'm doing wrong here. I've used MakeMKV to rip several episodic blurays with no issue, but for some reason, this particular one is having issues with only one of the episodes and I kept getting a read error. I downloaded DVDFab in case it was a software issue but its having the same problem. The disc looks fine and has no damage or marks. I gave it a clean anyway but am still having problems. This episode also plays fine on my PC with the same disc drive, so i'm really stumped at where the issue lies??

Should I buy a new disc? A new drive? Or is it a software problem?

Any suggestions are appreciated, thankyou!

7269
 
 
The original post: /r/datahoarder by /u/halfdepressed on 2024-08-19 11:17:41.

Hey everyone, I apologize for the elementary question and perhaps misunderstanding here. I have a Synology that I use to backup some directories too.

I am trying to consolidate and merge an internal directory that’s pictures and videos to my Synology. Over the years it’s become a little scattered between the two. I used Vice Versa Pro to calculate the MD5 and even Sha256 to get the most accurate comparison of what’s missing.

It seems like my network storage now has less space? Will generating the hashes cause data to be eaten up?

7270
 
 
The original post: /r/datahoarder by /u/NinjaTrue166 on 2024-08-19 10:45:03.

I want to download videos that are in a video player and the application does not have a download option

7271
 
 
The original post: /r/datahoarder by /u/Spazza42 on 2024-08-19 09:48:51.

Hi everyone, I’m looking to set up storage through my router to access as a backup drive but also use on my Apple TV 4K using Infuse. I own a BluRay player and have been tempted to move back to a physical collection but I’d prefer a setup that integrates neatly into the one I already have.

What I’m looking for:

  • Integrates well with my Apple TV 4K unit.
  • Store and watch backups of DVDs, BluRay and UHD BluRays.
  • Be inexpensive to buy, maintain and operate. Preferably set and forget.

Option 1 - Simple plug & play portable SSD into the router, access through Infuse and add files over USB or network. This is clearly the cheapest route but I’ve read a lot about reliability issues having SSDs plugged in via USB 24/7. Only looking for 2-4TB of storage.

Option 2 - Found a simple mini PC (Blackview MP80 or 90) - runs around 12-15w, costs around £180 excluding drive expansion. This could expand into being a full media server to use with Plex or iTunes home sharing - nice feature, not bothered either way though. Anyone have any experience with N95/97/100 PCs as a server?

Option 3 - Get a dedicated NAS and do it “properly”, obviously costs more but will likely not have issues. Fully expandable but way more storage than I need.

View Poll

7272
 
 
The original post: /r/datahoarder by /u/vanillapenguins on 2024-08-19 09:31:00.

Are there any benefits with using the SDI-output instead of the FireWire for transferring DV-tapes to computer?

What if the tape has some damage, will I be less likely to get drop-outs using the SDI or FireWire?

This last question might be very stupid!!!

There is a video and film digitization company near me that used the SDI-output for transferring my DV-tape. Was It a misstake or can it be common practice among some of these companies?

7273
 
 
The original post: /r/datahoarder by /u/greenie4242 on 2024-08-19 09:20:39.

I purchased five Recertified Seagate EXOS X18 16TB ST16000NM000J SATA drives for use in a Synology DS423+ NAS. One as a cold spare. Running SHR-2, need redundancy not capacity.

Hard Disk Sentinel Pro on a spare PC testing all drives multiple times before installing them in the NAS revealed one drive significantly slower than the other four. About 10-12% slower which doesn't sound like much but adds 4+ hours to a full-surface sequential read/write test. Strangely another drive that consistently matches the other 'fastest' drives in short speed tests runs about 4% slower during extended operations. All HDDs reformatted to 4K Native before running tests. Swapping to different SATA ports made no difference.

R/W surface scan: 45 hours 53 minutes slowest 43 hours 21 minutes slower 41 hours 53 minutes fastest

The fast drives all almost exactly match the sustained maximum and minimum specifications from the official Seagate data sheet, but the slow drive is about 10-12% slower than spec. Otherwise they all seem to perform well. Seek times are identical.

https://www.seagate.com/content/dam/seagate/migrated-assets/www-content/datasheets/pdfs/exos-x18-channel-DS2045-4-2106GB-en_AU.pdf

From datasheet: Max. Sustained Transfer Rate OD (MB/s, MiB/s) 270/258 Random Read/Write 4K QD16 WCD (IOPS) 170/550

R/W Transfer speed curves look fine with the fast drives starting at 263MB/s and slow drive starting at 230MB/s then all gradually slowing down but never below 110MB/s. Temperature curves all look fine with some drives reaching 40C and a couple reaching 48C which could be due to the enclosure.

Even the slowest drive will of course easily saturate the gigabit LAN port, but I'm concerned something might be wrong with the drive. Also it'll take an extra 4+ hours to rebuild the array when needed. Maybe Seagate artificially speed limited it during the recertification process? I don't know.

Should I contact the seller for a replacement, or is this a non-issue? The warranty is through an Australian reseller, not a standard Seagate RMA. Hopefully they'll be fine with it, but I'd rather not have to go through the process if it can be avoided. I can keep the slower drive as the cold spare, but if it's already faulty in some way that might be a future problem I can nip in the bud right now.

I'd appreciate any advice from people with experience running multiple EXOS drives who may have encountered a similar situation. Thanks in advance!

7274
 
 
The original post: /r/datahoarder by /u/Alexm4664 on 2024-08-19 08:55:45.

So I work for a large company that doesn't always choose the fastest and easy solutions for recovering from system failure. SOP is to do a full system replacement and software install instead of restoring from a back up. Systems are not on UPSs so when power goes out files get corrupted and a restore is more then adequate in my opinion. Anyways my old facility with same company was actually pretty good and used Ghost, we had systems back up and running in like 5 minutes because we had clones of every drive. I still have a copy of it on a bootable flash drive but also looking for other useful software. I don't need any data recovery but hard disk health would be nice. Mainly looking for relatively quick tests. These computers control machinery so lack of downtime is the most important thing but would be good to know if the drive if the drive will fail again so I can just replace it while the machine is down.

Thoughts?

7275
 
 
The original post: /r/datahoarder by /u/ZiggyQuidz on 2024-08-19 06:39:20.

Any one here using or have used one before? I've had an issue with my lone HDD drive on my pc, it gets undetected at least once/twice a year (got the drive 2022) for no reason, it's an archive drive, dump my finished projects on it for the year. Checked the disk each time, no issues on it, so I'm guessing something it my pc could be messing with that drive? maybe ground? anyways that's why I bought this 5 bay enclosure, do you still need to eject the drive before shutting down or removing the enclosure after using? or is it ok to just shutdown my pc, then turn off the switch on the enclosure?

view more: ‹ prev next ›