It's A Digital Disease!

The original post: /r/datahoarder by /u/OLED_display on 2025-01-24 21:16:12.

So, I got a boatload of 12 and 14tb SAS drives recently and I learned that like their SATA brothers, they dont like 3.3V power. For test case, I cut one of the sata power cable's 3.3V line and the drive is working as it should. I am just curious, why cutting this 3.3V line is not preferred over taping the 3rd pin or buying a molex-sata adapter? To me this is the easiest way to defeat the power disable feature.

The original post: /r/datahoarder by /u/theoldgaming on 2025-01-24 20:43:26.

The original post: /r/datahoarder by /u/Matti_Meikalainen on 2025-01-24 20:21:19.

The original post: /r/datahoarder by /u/Sp00d3rMan69 on 2025-01-24 20:16:52.

Okay, so I'm trying to expand on this laptop I had sitting around, it's got a nvme slot in the system, Idk the exact specs on the slot itself but I was wondering if there's some sort of DAS or any sort of thing that would plug into that and use the PCIE lanes on the port rather than going with the 3.0 Type-C port on the side or if that would even be a good idea to use, I'm just curious what would be my best course of action on scaling up on this thing so I can have a use for some of the HDD's I have laying around doing nothing. If there isn't one specifically like I'm looking for, is there another DAS enclosure any of you guys would recommend? any advice would be appreciated. Thanks in advance!

The original post: /r/datahoarder by /u/lucas-haux on 2025-01-24 18:30:38.

Hitachi Ultrastar drivers made for servers. I know a lot of them will fail but I think its worth it, am I crazy?

The original post: /r/datahoarder by /u/Wimoweh on 2025-01-24 18:06:31.

Not sure if this is a dumb question but I've never really used an external HDD. My worry is that if I get one (looking for a 4tb one to backup all my important files periodically) is that it will have some dumb software on it that will get in the way of me using it. I already use duplicacy on all my machines to backup to the cloud and my plan is to just add folders on the external HDD as secondary storage locations and do the backup via duplicacy. Can I do this using any external HDD (maybe needing to format it first?) or are there any considerations to keep in mind? I also want something I could connect to either windows or linux (but I guess as long as I can format it as NTFS I'll be good right?)

The original post: /r/datahoarder by /u/LittlebitsDK on 2025-01-24 17:40:59.

I was looking at getting some more ST12000VN0008 drives and noticed they had gone up in price a fair bit here... and saw that another site sells ST12000VN0007 refurbished for HALF the price... I am "ok" with refurbished, but is there anything different on these I should be aware of? I am quite happy with the ST12000VN0008's even though they are fairly loud, not helped by the resonating case they are in for now (to be moved eventually) but can't see any difference spec wise other than a different "sticker" on the front

The original post: /r/datahoarder by /u/WindowlessBasement on 2025-01-24 16:42:46.

The original post: /r/datahoarder by /u/randylush on 2025-01-24 16:31:18.

Drive level compression was sort of popular way back in the day when disks were tiny.

I have about 18tb of storage that I use for various things and my 10tb "main" partition is starting to fill up.

I went to back it up using Duplicati and I was amazed to find that the backup itself only took up like 3tb!

So if I was using drive-level compression then I'd be around the same usage.

Wondering if any of you all do this on your network shares. Seems like you'd get more space, but it would be harder to predict when you run out of space. I'm not worried about performance because I have a 1g network and I'm pretty sure my server can zip faster than this.

I'm just using samba with a linux distro for my network storage, no proprietary NAS.

The original post: /r/datahoarder by /u/PricePerGig on 2025-01-24 16:07:52.

The original post: /r/datahoarder by /u/flock-of-nazguls on 2025-01-24 16:04:37.

This is slightly OT, but I need a solution that both our datahoarder customers and tech-illiterate customers will approve of.

We sell media products (classes), each of which is made up of about 10-20 individual mp4 video files of 5-60 minutes each (lessons). We offer both SD and HD renditions, but generally the files are pretty large, so it's not really efficient to just zip them up as a single file.

The vast majority of users own 1-2 products, but we have many with dozens, and a few thousand customers with hundreds of purchases. They're in for some major suffering if they want to download everything!

There are download links for each product's videos, but it's annoying to babysit click/save downloading all the files. Users with really crappy connections have a Bad Time because we use signed CDN links that expire after a couple hours, so they can't even use the browser's "resume" on error if they walk away.

We have a couple candidate ideas:

• write a small Electron app as a downloader (relatively higher effort and adds support headaches)
• do the user ownership check in a CDN lambda (read: allow long-lived links that work if you're logged into the main site) and suggest a 3rd party downloader

I'm still leaning towards a custom downloader (could also pre-structure directories for Plex or other player?) but we're pretty tight on resources, so if I could instead just say "point this free app at this url and it will do the right thing", that would be a week or two of my life I'd get back.

Suggestions? Thanks!

The original post: /r/datahoarder by /u/manzurfahim on 2025-01-24 15:54:47.

I have about twenty enterprise grade drives: a mix of 16TB / 18TB / 20TB drives. Four of these drives were purchased new, all other ones are recertified. I do not see any difference in performance, but of course the recertified drives were in use before they got recertified.

My use-case: I use eight drives with a hardware RAID controller (RAID 6), all the other drives are offline drives, data off-loaded from PC (two copies each).

My question is, I can see 20TB EXOS refurbished drives are about $20 cheaper than brand new Toshiba 18TB enterprise drives. Is Toshiba good? I mean, enterprise drives do have a certain performance / reliability to maintain, right? For $20 more and 2TB less, are Toshiba brand new drives a good purchase than buying recertified Seagate / WD?

The original post: /r/datahoarder by /u/ThatFeel_IKnowIt on 2025-01-24 15:53:48.

I know disk management dynamic disks are deprecated. However, I've been using them for a while and it seems to work? I have 2 HDDs that are dynamic and mirrored via disk management. These are NOT os drives. Just data drives. I would like to find another newer solution. My questions are as follows:

1. What is the risk of continuing to use dynamic disks for disk mirroring? Why does Microsoft say not to use it if it works okay? Is it the other types of software RAID that are dangerous? Like parity, etc. Is just using it to mirror drives okay?
2. What should I use instead? Storage spaces? Motherboard hardware raid? Should I buy an external hardware raid module to use rather than the mobo one?

Thanks!

The original post: /r/datahoarder by /u/KeyCardMaster on 2025-01-24 15:49:13.

The original post: /r/datahoarder by /u/elleyer on 2025-01-24 15:18:31.

Hello! I'm looking for a case for my NAS. The board is Micro ATX so I need something like Fractal Node 804. However, those are expensive for my budget. Are there any alternatives? Thanks!

The original post: /r/datahoarder by /u/T-45C on 2025-01-24 14:29:32.

I know I could look it up but I’ve been researching and there really no definitive answer. I would like y’all’s opinion for an extremely reliable usb stick for 1-2 Tb of data.

The original post: /r/datahoarder by /u/ThowZzy on 2025-01-24 14:03:23.

Hello everyone,

I have a DIY NAS running baremetal debian. My storage is 2x 4TB HDD in a mirror using ZFS. These drives have around 1.5 years of runtime.

I use this mirror to store irreplaceable videos/photos/documents (around 600-700GB) and host a jellyfin instance and im currently at 2.5TB for it (less important). I clearly need more storage but not sure which path to take from there.

What I currently think I could do:

1. Buy 2x 4TB drives to add another mirror to the current vdev -> "RAID 10"

2. Keep the current mirror untouched and use it only for the irreplaceable data and buy like 3x 4TB, create a RAIDZ1 with those and use this for jellyfin only. So "RAID1" for my important data and "RAID5" for the less important movies/shows.

3. Completely convert to a RAIDZ1 after buying 2x 4TB drives to store everything on it and get more data with this type of raid. (So 4x 4TB "RAID5")

4. Still open to use something else than ZFS if it would benefit me in this situation.

Let me know what you would do and if I didn't miss anything.

Note that I do value the possibility to expand my storage in the future, could be by adding more drives OR by replacing existing drives to a higher capacity.

And FYI my case can hold 8-10 HDD and my motherboard has 6 sata ports. Thankssss

The original post: /r/datahoarder by /u/Bennedict929 on 2025-01-24 12:56:51.

The original post: /r/datahoarder by /u/Stressemann on 2025-01-24 12:28:08.

Hi all. I did a substantial overhaul to my TN box, upgrading the mobo+cpu, a PCIE 1x to 2x SATA card and a 2.5g card all in 1 shot. Previously my 4c8t box was easily handling gigabit uploads and downloads via SMB, but after the upgrade to 6c8t and 2.5g......Well technically its above gigabit uploads, at 127ish MB/s, but clearly nowhere near the 300MB/s it should be getting. Downloads is much closer, and acceptable speeds at 250-270MB/s, but I was wondering if it was the parity calculations that is causing such a slowdown to my upload speed.

The original post: /r/datahoarder by /u/NYCphotographer on 2025-01-24 12:12:50.

The original post: /r/datahoarder by /u/s_nz on 2025-01-24 08:53:58.

A sharp price on use 18TB drives (ex data center, matching my current setup) came up in my local area.

Currently have three of the same drive in my 8 bay NAS, N-1 setup (which is still fairly empty), and now have two spare / future drives. Running a long smart check on them now.

Thinking of putting one into the Array (but not strictly required at this point), and wondering what to do with the remainder?

• Just put it into the Array too
• Cold spare
• Additional redundant disk
• Hot spare
• Additional backup drive?

For backups I have two of the same drives which I am going to put in USB enclosures, one of which I plan to leave connected to the NAS running backups, and the other in a remote location to physically rotate monthly. Only intending to back up stuff that can't be replaced, (currently under 4TB, so the 18TB disk's has space for a few several years growth)

The original post: /r/datahoarder by /u/karstenlee10 on 2025-01-24 08:15:50.

What My Project Does: It uses youtube and twitch api with ffmpeg and selenium chromedriver to live stream to your archive channel.

Target Audience: For streamer's fans to archive their vods.

Comparison: Normally people will download the vods and then upload it to youtube, and my code don't need these steps.

also if you know about youtube or twitch api or selenium chromedriver, you can help me improve the code by submitting an issue on the github page

Source Code: https://github.com/karstenlee10/Twitch_B2_Archive_To_YouTube

The original post: /r/datahoarder by /u/Refleks180 on 2025-01-24 11:00:38.

While I understand MicroSD cards are not good for long term archival storage, I was interested in storing a veracrypt encrypted backup of my data onto a 1TB microSD card as a "backup of a backup" (I already use a regular external SSD for my off site backup) because it fits in my wallet and can be a true "edc" copy of my important files.

My issue is that I do have files over 4GB so I need to use exFAT or NTFS, and my understanding is that NTFS is superior due to journaling if I'm only planning on using it on windows, while exFAT has a much higher chance of data corruption. I do only plan on using this on windows but.... it would also be nice if I could use it on other devices too like a normal thumb drive. For this use case, I don't plan on having any files larger than 4GB.

Is it viable to have my backup stored on an NTFS partition and the remaining space be a normal Fat32/exFAT partition for use as a regular thumb drive that's multi-device compatible?

I've bricked microSD cards in the past, and it makes me a bit nervous to try this out on something I spent almost $100 on so I wanted to bounce the idea here first. If this is a stretch I'll just do it all NTFS and carry a separate, smaller thumb drive if I need multi device compatibility.

The original post: /r/datahoarder by /u/Another__one on 2025-01-24 10:47:17.

The original post: /r/datahoarder by /u/djtron99 on 2025-01-24 09:58:11.

Hello. Which OS and file format should I install on my 2 DIY home NASs. Main consideration is to easily put the hard disk to another NAS if the hardware can't be repaired. I'm not keen to have RAID features as I will just backup.

1st NAS 6 bays hotswap: i7 5675c 4c8t,16gb ram

• Main storage for home
• Home streaming 720 or 1080p media
• turned on as needed

2nd NAS mini itx: i3 7100 2c4t, 8gb ram

• Backup storage for home
• Planning to do dual boot windows and the OS in question so I can still use at as standard computer.
• turned on as needed

I already have an Intel NUC, i5 8259u, 16gb ram

• Mini storage
• 10 to 16hr/day operation
• dockers

I'm familiar with proxmox and omv. What's also your take with windows server 2019 (I've got it for free)?