The original post: /r/datahoarder by /u/Piotr_Lange on 2024-07-14 09:43:32.

Hi folks, In a few months I'll be starting my studies at a university. I'll live in a dormitory and so I need to move my internet-facing infrastructure there.

I have a NUC serving as a server with some sites and Nextcloud on it. Moreover, I'll have a PC with Ethernet and a few Wi-Fi devices. I'm in talks with the administration to open my server to the internet. I'll have access to at least one Ethernet port in my room to connect my router.

However, I still need a router for my setup. I would like it to be as open (both hardware and software) as possible. I already have some experience with OpenWRT and looked at their hardware page. I also wouldn't refrain from doing something DIY, such as basing my router on a Raspberry Pi.

My budget is quite flexible, but I'd like to stay somewhere near 100-150 USD.

What would you recommend?

The original post: /r/datahoarder by /u/Warcraft_Fan on 2024-07-14 09:25:38.

Hydrogen is cheaper, equally lightweight, and in pure form it's not combustible so theoretically a sealed hard drive with hydrogen should work about as well as helium drive. Plus with hydrogen is lighter, which could shave a few pounds off entire case of drives and cut cost of shipping by some.

So I was wondering, why hasn't that happened yet? Afraid that if the drive springs a leak, it'd blow up?

The original post: /r/datahoarder by /u/Fit-Injury-5887 on 2024-07-14 18:37:19.

I’ve downloaded all Reddit data from 2005-2022 available on https://the-eye.eu/redarcs/.

Is there a one-stop shop tool, complete with GUI, to browse and search across these files for a holistic “offline Reddit” experience?

I found several tools on GitHub that do a portion of what I’m looking for (export any single post to HTML, search for keywords across the archive, etc.) but couldn’t find any all-in-one solutions. TIA.

The original post: /r/datahoarder by /u/niluvani on 2024-07-14 18:25:20.

Hey all,

Somewhat new here, sorry about that.

Is there a good open source software that I can use to easily find what I'm looking for?

I have ~40 tb of movies, tv shows, youtube channels and would really love to have some sort of "smart homepage" or searching system to help me search by genres, actors, by year, etc.

All my stuff is tagged appropriately, but at this moment, I am still manually searching in each folder of what I want to watch so I am looking for some kind of interface to better help me navigate my files

Thanks

The original post: /r/datahoarder by /u/Ldn_brother on 2024-07-14 17:39:53.

I recently took an interest in hoarding 4K movie files most of them hover around ~65gb.

For storage I'm just using sandisk micro SD cards that are 1 terabyte, as you can imagine these are starting to stack up big time and the SD cards themselves are not the cheapest.

I don't really have a PC setup because of the space limitations in my home, so I thought the SD card route is probably the most efficient and safe route. Is there anything more I should consider and do apart from possibly cloning the SD cards for backup purposes?

The original post: /r/datahoarder by /u/BosnianSlavemaster on 2024-07-14 17:00:14.

I'm currently trying to download mapgenie.io (which also hosts rdr2map.com ) for offline use (or in case it ever goes down). I've tried just right clicking in the browser and clicking "Save as..." but it only saves the current page, and I have no idea how to structure them in folders if I ever have to download them. Not only that, but the pages look all messed (it seems because of javascript or something).

I've tried Httrack but, not only is it excruciatingly slow (because I imagine it is going over the same links again and again), but the display is also messed up. That, and when I tried changing a few settings, it just resulted in showing me html files in plain text instead of displayed. It is also unable to access the images used in those maps (because mapgenie uses tiles to display the map for zooming and stuff). For example, here's a tile from the RDR2 map, which I found by using the record function in the network tab, dev tools (F12). I've let it run for about 20 hours combined (on multiple tries, my longest being 14h, which amounted to over 60 GB!!!) and I haven't seen a single .jpg like this apart from the default markers the website uses (location icons).

Now, I'm looking for anything that could "allow me to download a website" (excuse me, I don't know the terminology, not sure what I'm doing), and I've seen curl and wget proposed, but these things elude me. To add to that, apparently it's hard to "download a website" because of javascript. Such is why it is displayed all messed up.

So, please, help me, because I know I'll regret not archiving this website. Also, I've got multiple terabytes of storage, I don't think this website is any bigger than 20 GB.

Also related

The original post: /r/datahoarder by /u/Eteris on 2024-07-14 08:56:33.

Good day, I'm hoping someone can help me in my current dilemma.

I'm currently running a Synology DS1815+ with 8x4TB WD whitelabel (shucked) drives in SHR. I recently acquired a couple of 12TB HGST HC520 drives and wanted to use them to upgrade my storage capacity. The drives were all tested (and passed) using Hard Disk Sentinel's destructive surface test.

However, as I replaced my first 4TB disk, the Synology told me I couldn't use it as it was 4k native block size whilst my existing disks were using 512. I started to do some research and discovered that I could use HUGO/wdckit to change the block size on the 12TB drive. So, I connected the drive to my main PC via a USB-C dongle and performed the following in Hugo: format -b 512 --fastformat -s

The command started to execute and failed (unfortunately I don't have the failure error anymore). Since then the drive is no longer properly recognised by Hugo/wdckit and I can't partition/use the drive (CRC error when trying to partition using windows disk manager). I then connected the drive direct via sata and the drive is seen in BIOS/HD Sentintel, but any attempts to use Hugo/wdckit to run further commands are futile - as no serial is listed I cannot re-run the format command. I've tried specifying the model number using "-m" but the tool claims no model exists. The drive no longer shows a serial number in Hugo and is also listed as SAS rather than SATA. I've installed various WD/HGST tools and they don't recognise the drive.

So, the drive is physically working and reported to HD Sentinel, SMART is fine, but I've screwed up the sector allocation, possibly because I attempted this via a USB-C dongle rather than native.

Am I screwed? What "should" I have done and is there any way to recover this drive?

https://preview.redd.it/42mr73tb8gcd1.jpg?width=837&format=pjpg&auto=webp&s=87828d99c755d80fc1d67e442725ae450e1283a8

The original post: /r/datahoarder by /u/C_V_Carlos on 2024-07-14 16:01:19.

Hi everyone,

I need to connect two new 4tb ironwolf disks to my nas but I am out of sata connector on my psu, a CV650

Which options is better? A sata splitter that will connect my two disks and a fan hub

StarTech.com 15.7 in (400 mm) SATA Power Splitter Adapter Cable - M/F - 4x Serial ATA Power Cable Splitter (PYO4SATA) https://a.co/d/cHDCiqV

Or a molex to sata adapter that will connect two of the disks.

Monoprice Data Cable - 2 Feet - 4-pin MOLEX Male to 4X 15-pin SATA II Female Power Cable (Net Jacket) https://a.co/d/4yN00Ol

Also which will be a long time solution? I guess it will be to change my psu, right? I am planning to expand my nas up tp 12 disks, currently at 6, not counting the 2 new ones.

The original post: /r/datahoarder by /u/syclonefx on 2024-07-14 15:14:53.

I made a noob mistake and bought a WD My Cloud EX2 NAS with 8TB of storage. Not thinking it would only really be 4TB since it is set up as a RAID 1 array. I filled this up really quick and I'm not even close to ripping all of my movies yet. I've got about 250GB of space left and I still have 10 4K UHD Blu-rays to rip and about 70 1080P Blu-rays to rip. I also have a crap load of DVDs, mostly TV series that I need to rip.

So I'm looking to buy a new NAS that I can expand over time when I need more storage. I'm looking at the Terramaster F4-423. Anyone here have this NAS or know if it is a good system. I don't want to spend too much on the enclosure because I would rather spend the money on storage instead. I'm going to use this as a Plex server.

The original post: /r/datahoarder by /u/omgcornholio on 2024-07-14 15:05:53.

Hello Reddit Community!

I finally decided to venture into the world of Network Attached Storage (NAS) and would love to hear your thoughts and advice.

A bit about myself: I'm a digital marketer, gamer, dog dad, and computer geek. Recently, I decided to dive into the NAS world to better manage my digital assets and enhance my home media experience.

Here's my setup:

• I recently purchased two Seagate Exos X16 16TB 3.5" SATA hard drives.
• I paired them with a TERRAMASTER F4-423 4-Bay High Performance NAS.

My immediate goal was to archive my collection of courses and marketing-related SOPs, tools, etc. But as an avid Plex user, I'm also looking forward to building my personal collection of content (note: I buy digital movies/shows, so this would have more limited use).

If there is enough interest here, I'm happy to report back on my thoughts of setting up a NAS for the first time, or my experience with the TERRAMASTER NAS products overall. I should be getting the NAS today and plan to work on setting it up.

Now, I have a few questions for this knowledgeable community:

Questions for the Community:

1. Resources for Getting Started with NAS:
   • What are some good resources for a newbie like me to get started with NAS? Any recommended blogs, YouTube channels, or forums that offer valuable insights and tutorials?
2. Features/Benefits of NAS Beyond Media Server/Storage:
   • I know NAS is great for media servers and storage, but what other features and benefits should I explore? Are there any hidden gems or lesser-known functionalities that could enhance my NAS experience?
3. Choosing the Right NAS Setup:
   • Did I go with the right NAS setup? I'm curious if the TERRAMASTER F4-423 is a good choice compared to getting a QNAP, Synology, or even a custom build. What are the pros and cons of each option?

I appreciate any tips, tricks, and advice you can offer. I'm excited to embark on this NAS journey and make the most out of my new setup. Thanks in advance for your help!

Looking forward to your responses!

The original post: /r/datahoarder by /u/jfromeo on 2024-07-14 14:56:13.

The original post: /r/datahoarder by /u/chaplin2 on 2024-07-14 14:24:59.

There are posts that NVMe disks have prices that have fallen down, fast speeds, lower power consumption, lower noise, and perhaps better longevity (see Pure Storage website). Meanwhile, all-flash storage and NAS with 10G networking are coming to the market. They say NVMe storage is the future.

Is it true that network attacked storage is becoming all flash ? Is an all-flash NAS a better investment than HDD NAS in 2024?

I’m not convinced that HDDs will not the storage medium in consumer NAS. To take advantage of the NVMe speeds, you need a server cpu such as Xeon, and 10G networking everywhere. Also, right now many applications don’t benefit from speeds above sata. Certainly not if accessed over internet.

What do I gain in real life from a 12-bay NVMe NAS that I don’t get from an enterprise HDD NAS?

It looks to me flash storage will remain a niche market, for video editing, VMs, large file transfers, ..

The original post: /r/datahoarder by /u/CommercialLocal6030 on 2024-07-14 13:42:06.

Is there a cheapish and lower power way to connect 4 u.2/u.3 gen 4 drives to a 16x gen 4 pcie slot?

1. It’s unclear to me which (lower cost) motherboards support PCIe bifurcation

2. it’s not that obvious if any of the add in cards with oculink actually work

3. putting u.2/u.3 drives in a consumer case seems pretty kludgy.

Has anyone solved this problem?

The original post: /r/datahoarder by /u/Life_Show8246 on 2024-07-14 11:26:34.

Greetings Storage wizards 🧙‍♂️. I have a 16TB exfat formatted hard drive with various personal pictures and videos which I would like to have backed up somehow. I've thought about a couple different things:

1. I've thought about buying 3 new 16TB drives and setting up RAID 5 or 6 as this would also give me some additional space addition to redundancy for my data.

• Here I've heard a bit of back and fourth between whether or not I should go for 5 or 6 based on rebuild times and potential URE issues with RAID 5 which could render the redundancy useless. Shouldn't the drives be able to scan for UREs? Rebuild times aren't an issue for me, as long as it's under a month it should be fine.

2. I've also thought about going with just buying another 16TB drive and setting up some sort of backup to it from my main 16TB drives. However if I choose to do this I have 2 questions.

• How can I ensure that in case the main drive gets some corrupted sectors that it doesn't back this newly corrupted data up to my backup drive?

• I'm on Windows at the moment, so which backup tools would you recommend if I go with this solution?

Which option should I pick? And if none of the 2 options above seem applicable, what would you recommend?

The original post: /r/datahoarder by /u/FluidVeranduh on 2024-07-14 09:39:30.

The original post: /r/datahoarder by /u/Tomarush on 2024-07-14 09:15:01.

Hey Everyone,

I am just getting started with data hoarding and am curious how you all would spend a $3-$5k budget on a server?

Here's some context:

1. You will be giving access to the files on the server to people and will need different levels of access that can be assigned.
2. The files will range from movies, music, photos, photoshop assets, programs, etc.
3. You will need at least 50TB.

The original post: /r/datahoarder by /u/kurbster1 on 2024-07-14 06:37:59.

The original post: /r/datahoarder by /u/Gskinny on 2024-07-14 02:12:44.

I want to expand my current movie storage setup and looking for advice. This will not be a NAS currently but possibly in the future. My current setup is a home pc and already too small to fit anymore hard drives in it(I currently have 2 10tb). I use my home pc to watch all my movies and shows. Money isn't really an issue but I'm not trying to spend willy nilly, i'd rather put that money into more drives than a fancy rig. My goal is a separate enclosure that sits next to my homepc direct connected to it with 100tb of storage space(50tb, 50tb backup) and a program that i can use to keep the backups backed up when i click a button.

So a few questions on cases, hard drives, and software:

Case: I'm looking for a new enclosure/case. I don't want to spend 400$ on a 4/5 bay synology or qnap premade enclosure when i want to expand in the future to a server rack) I'm thinking a homemade 5 bay enclosure? Any good options or guides for that? or Whats a good home starter server rack?

Hard drives vs SSD: I understand hdd is cheaper, but i worry about drive failure and i value the read/write speeds of ssd way more. Seems i can get maybe 20tb of m.2nvme drives for the same price as 100tb of seagate exos hd drives. Why do most people not choose ssd when they seem to be more reliable, no noise, smaller, and faster? Is there even a storage solution using only ssd that i can take a look at? ( i don't mind spending thousands if my ssd aren't at as much risk of drive failure like an hdd and I'm future proofing

Program: I manually manage my files and folders. I used chatgpt to write a powershell script for my home pc(windows) to organize my films and shows. What's a good program i can use to backup my files and folders to the backup drives as if its a 1:1 copy? Besides just drag and drop like i do in windows now(which takes forever(100mps)

I probably will have more questions, but thank you for the help in advance!

The original post: /r/datahoarder by /u/dkpc69 on 2024-07-14 00:54:58.

The original post: /r/datahoarder by /u/ifnbutsarecandynnuts on 2024-07-14 00:41:15.

The original post: /r/datahoarder by /u/Illustrious_Scale730 on 2024-07-13 23:32:44.

title. need an external hard drive of at least 2tb but obviously the more the better and I have a relatively low budget of around $100 CAD (~75 USD right now) but can go slightly over. for my budget I can get more storage with an HDD, so is it a good idea to go for an HDD instead of an SSD in my case of strictly using for long-term photo/ video storage? looking at something like this (can anyone confirm this is an HDD to me?) or this but let me know if there are better options you know of.

The original post: /r/datahoarder by /u/angryjew on 2024-07-13 23:31:07.

I have a NAS and already have 8 14TB Seagate Exos drives. I wanted to expand my storage some more but I cannot find these anywhere. I got my previous ones on Amazon for $15/TB and they dont seem to exist anymore for under $20. Does anyone have any ideas on where I can look?

If I have to go refurbished, what site should I use and price should I look for?

The original post: /r/datahoarder by /u/BARBCEUE_MASTER on 2024-07-13 21:01:29.

Im kinda a noob when it comes to nas, i can’t really find much of a difference between wd black and red. Red is made for nas and black is like for gaming. When i look at both its so simple in just about everything the drive can do. Obviously red is the choice for building a nas but it has a 3 year warranty while the black has a 5 year warranty and a bit cheaper. Will it be bad to use wd black for a nas?

The original post: /r/datahoarder by /u/crescentwire on 2024-07-13 20:01:15.

Not sure if this is the right place to post about this, but I can't seem to find another suitable subreddit. I have a Samsung 970 EVO Plus SSD running in an admittedly cheap, heatsink-less enclosure via USB-C.

I'm using this as a backup target, and under full write activity, the temperature got unbelievably hot. 85 C (185 F). I'm really worried that I'm going to kill this thing if it runs this hot all the time.

Yes, that's a digital meat thermometer in the photo. It's all I had to check the temp with.

Aside from getting a heatsink-based external enclosure, should I be taking any other actions to lower the operating temperature?

Thanks so much in advance.

The original post: /r/datahoarder by /u/Dr_CSS on 2024-07-13 19:56:16.

I am upgrading the motherboard, so all components except that will be the same. Will I be able to simply plug in the hard drives and windows will recognize the volumes?

They are plugged in on the regular SATA ports, and the mirrored volume is managed by Windows Disk Management

B550 mobo is the MSI b550 M-Pro VDH WiFi

X570 mobo is the ASRock Steel Legend