It's A Digital Disease!

The original post: /r/datahoarder by /u/broomosh on 2024-07-03 19:02:58.

I need a little bit more space :)

Anyone seen any good deals on internal HDD's for 4th of July? Preferably new.

The original post: /r/datahoarder by /u/clerbird321 on 2024-07-03 18:39:05.

Hi everyone!

I have a ton of photos and videos on my iPhone and thus far only have iCloud to keep them in check. Basically I want to find the best and safest ways to backup these memories, preferably multiple while still using iCloud, so that if anything happens with iCloud I’ll have multiple fallbacks. I was thinking about using Google Photos and a Sandisk iXpand drive, but I’m a bit weary about Google Photos being that I’ve read that iCloud Photos and Google Photos don’t get along well on the same device and can delete images and videos. Can anyone help with this?

I’m also working on cutting down on the amount of photos and videos I have, but I want to back them up now while I work on that.

Another question, if I use the iXpand drive and put the photos and videos there, would I be able to plug that and another flash drive into my laptop at the same time and copy everything from the iXpand into the other one, without having to move everything onto my PC first? I don’t have enough space on my laptop so I’m curious if I could do that and have 2 flash drives with my memories.

The original post: /r/datahoarder by /u/RedditSucks93 on 2024-07-03 17:07:45.

So basically my plan is this. I want to buy four 18TB HDD refurbished drives and logically combine them in a way which allows them to be encrypted, and use two for a backup. The issue I'm running into is absolute redundancy, I'm wondering if I'll be able to recover data from the backup drives if my main computer (along with it's software JBOD configuration) is wiped. I need something that I can easily access using anything from my current gaming PC down to a ThinkPad.

Also, I can't buy all four immediately, so I am thinking of buying two first and using them individually, then buying two more down the line and making two seperate JBOD volumes.

TLDR: My questions are:

1. Is there software for JBOD (or something like it) that allows for recovery of data from any PC, even one that didn't originally set it up?

2. Is there something better than JBOD that I can use?

3. Would it be better to store my data individually (some on one drive some on the other?

4. Should I directly connect drives to my PC or use something like a Mediasonic hard drive enclosure?

Thanks for any help. I'm a real noob but I appreciate you guys.

The original post: /r/datahoarder by /u/slipperyeggs on 2024-07-03 16:55:16.

I'm hoping to get some advice on a home media server/media hoarding, and I'm unsure about specific hardware to get and about having a home server PC vs getting a server rack. I'd like to run a plex server, which would probably be used by only a few people at a time, with at least ~100tb of storage (to start), and having enough drive bays for more than that is even better

I'm not familiar with rack style hardware at all, but the reason I'm considering that is because I'd imagine I should be able to get more hardware to hold more HDDs if I run out of bays, right? Would a server rack continue to be expandable as long as I have rack space for it? Maybe that's overkill if server hardware would be significantly more expensive, but I'm not sure if I could expand if I've already maxed out all the drive bays in a PC case. I was also considering a dedicated NAS, but I thought this might be a bit more expensive than a PC and even less expandable than other options

I'd be willing to spending couple thousand USD on this (excluding hard drives) if it's a good value. I'm hoping what I can afford now will be expandable and usable in the future if I want to scale up

The original post: /r/datahoarder by /u/SunriseOath on 2024-07-03 16:05:18.

I wonder if there is a way to download a static version of every webpage I go to during my regular Internet browsing. A part of me feels like this is already an inevitability as storage gets cheaper and cheaper, but recently I have been enjoying journaling my own online life and having a record of where I was when. Having all the pages I go to downloaded might not be that much more convenient overall than just having a browsing history already saved, but for the sake of exploring this topic I want to ask you all: Any existing solutions? Do any of you have experience with doing what I am talking about here, maybe with Obsidian integration?

(I could not find any results on Google, and so I turn to all of you!)

The original post: /r/datahoarder by /u/BoomerE30 on 2024-07-03 15:46:58.

Hi all,

Hoping to get some suggestions on the setup I am about to put together.

*Use case: * * Store 7TB of photos and GoPro videos (they take up about 6TB) * Regularly upload travel photos / videos from my and wife's iPhones * Have easy access to view and share photos/videos from the phone.

Setup:

• Synology DiskStation DS224+ 2-Bay NAS Enclosure - https://www.bhphotovideo.com/c/product/1781611-REG/synology_2_bay_diskstation_ds224_compact.html?ap=y&srsltid=AfmBOopx01hQ7KFegiAhuq9niNLMU0TK6yDyWJOaYwIWO9_arE19FqaLZNw
• 2x Seagate IronWolf Pro 18TB NAS HDD, ST18000NE000 SATA 6Gb/s 3.5" (Renewed) - https://www.amazon.com/gp/product/B0CZM957F3/ref=ox_sc_act_title_1?smid=A3A5W4Q2L5GNMH&psc=1

I don't plan to do anything advanced with this setup, to be honest, I am not even aware of what else can be done. So photo/document storage will be pretty much all I need it for.

1. Is this a solid setup or am I missing something

2. Are renewed HDDs from Seagate a big risk?

3. Are these price points reasonable ($300 for DS224+ and $180 for Seagate IronWolf Pro 18TB)

Thank you for any advice!

The original post: /r/datahoarder by /u/Default_mp3 on 2024-07-03 14:40:52.

I recently had to build a new array due to an HDD failure on my old one (after 7 years of continous use), and jumped on the deal on Newegg for the Ultrastar DC HC530 14 TB.

It is currently set up in RAID 0 volume using the mobo controller (ASUS ROG Maximus IX Hero Z270) using 3 of the Ultrastars, connected using the dongles provided by goHardDrive to override the power reset pin issue, on a Windows 10 machine. CrystalDiskInfo had shown no issues with the drives.

Right now, it appears to be deleting some of the newest files I put on the volume; I cannot determine how it chooses to erase/delete the files I put on, but it only seems to affect the newest files that are put on the volume. Filetypes lost include .jpg, .mkv, .mp3, and .flac, so no real pattern there. I should be extremely far from the overall capacity of the volume (sitting at around 14 TB used). Files that are being seeded that are deleted do not appear to be missing in the latest release of qBittorrent (v4.6.5) until I force a re-check, upon which it detects the files to be missing, though I will stress that there are files that are not being seeded that also disappear, so I don't believe that it is something related to qBittorrent.

Nothing obvious jumps out at me on the Windows Event Viewer. I get a large number of errors stating "Metadata staging failed, result=0x80070490 for container ____________", but my Googling seems to tie that to some other issue primarily on Microsoft's side.

I have tried rebooting the computer. I'm not losing much data due to the fact that I have BackBlaze and a second local back-up array (second computer on the LAN running RoboCopy every night, have been doing it for years and its never deleted anything via RoboCopy), but it is very, very annoying to have to keep doing recoveries, only to have many of the same files get deleted overnight again.

I do run an FTP server off the drive using Filezilla, but I don't believe I've given anyone but my own account the ability to delete files.

What else can I do to troubleshoot the issue? I'm considering wiping the volume and setting it up a JBOD instead just to see what happens, but then what do I do if that also fails?

The original post: /r/datahoarder by /u/DashOfSalt84 on 2024-07-03 14:24:14.

I have a miniPC running ubuntu with a usb connected 5 disk enclosure. I filled it initially with 6TB drives, and I'm reaching the point that I'd like to start swapping them for larger drives as prices have come down(12-14TB probably).

I've been having trouble understanding my options. I've got LVM2 partitions that use all the available space on each drive, and a single volume group that spans the 5 drives with an ext4 file system. I know this isn't a 'safe' way to do it, but this isn't critical data and I can get it all again if needed.

1. Is there a way to 'move' any data from the VG that is currently on one drive and spread it out to the other 4 drives? I think this is what 'pvmove' does. Not sure how it figures out if I have the space to do this, but at a minimum I think I would need 6TB of free space across the other physical volumes/drives to be able to do this.
   • If I can do this, can I then remove the 'empty' drive from the VG? Then I would swap in the new drive, format it and extend the VG across it.
2. If I don't have the space to use pvmove, if I have a separate enclosure for the new drive, can I format it, extend the VG and then use pvmove? I'm just not sure about swapping the new HDD into the enclosure after that. The 'data' would be the same, but would it be able to recognize/mount it after the swap? Since it's a VG that spans drives, I can't just 'copy' the data from one drive to another.

Thanks!

The original post: /r/datahoarder by /u/tsioulak on 2024-07-03 14:11:58.

I recently found www.servershop24.de (haven't ordered yet), are there any other EU shops that sell used hard drives?

I am more concerned with reliability, i want to be sure that if something happens (eg i recieve a faulty drive) i will be able to use the sales warranty.

PS. Is the www.servershop24.de reliable? Has anyone bought from them?

The original post: /r/datahoarder by /u/theCarbophile on 2024-07-03 13:43:16.

Original Title: If I get three of the following USB flash drives and store the exact same data on each of them while checking them for corruption every year and replacing them in case of failure, will this be a reliable long-term archival plan?

The original post: /r/datahoarder by /u/Danm998 on 2024-07-03 12:37:08.

I have published a FREE MySQL and JSON version of the DSM-V. I am working on developing my own AI-powered semi-private healthcare app, and I am doing it all 100% myself, so if you wish to use my dataset, please consider donating to help me with my own project if you're willing and able! It would really help me out with the development of my app. If you are willing to donate, please see the readme in the GitHub repo. TYSM in advance.

So anyway, this dataset contains all of the DSM-V disorders, their diagnostic criteria (organized into categories and subcategories, as laid out in the DSM-V), culture and gender-related considerations for diagnosis, prevalence data, recording procedures, and any other information provided about the disorder, conveniently organized and queryable, written in MySQL with a JSON export copy included as well.

Here's the link! https://github.com/Danm998/DSM-V

This took me a fair bit of work, so please consider donating if it helps you with a project of your own. Thanks in advance, I hope you enjoy!

The original post: /r/datahoarder by /u/WhatAbut on 2024-07-03 12:18:36.

Hi,

which home router would be best for home usage with 10GbE equiped NAS?

Specifically, I am thinking about buying UGreen DXP6800 Pro, it has two 10 GbE ethernet ports. I will populate NAS with SSD drives and use NAS for plex, docker, nextcloud, and backup with TrueNAS Scala installed as an OS. Initially, I will buy 1 GbE internet from my ISP, but I may upgrade to 2.5 GbE internet if it proves necessary.

My search so far landed me on these three routers:

• TP-link Archer BE550

  • 1x 2.5 GbE WAN
  • 4 x 2.5 GbE LAN

• Zyxel G5 Armor AX6000

  • 1x 2.5 GbE WAN
  • 1x 10 GbE LAN
  • 4x 1 GbE LAN

• UniFi Dream Router

  • 1x 1 GbE WAN
  • 4 x 1 GbE LAN
  • Great Software

With TP-link I get all five ethernet ports 2.5 GbE, with Zyxel I get 1x 2.5 GbE WAN and 10GbE for NAS. UniFi, on the other hand, has incredible software but it only has 1 GbE ports.

What are your thoughts? Feel free to recommend any other router you think is better than ones listed.

Thanks!

The original post: /r/datahoarder by /u/InternationalRub6124 on 2024-07-03 09:21:08.

Hi everyone,

I recently upgraded my gaming PC and ended up with an extra PCI-E SSD that I no longer need internally. I'm wondering if it's possible to use this PCI-E SSD as an external hard drive. Here are a few specific questions I have:

1. Compatibility: Are there any specific enclosures or adapters needed to convert a PCI-E SSD to an external drive?
2. Performance: How does the performance of a PCI-E SSD as an external drive compare to traditional external SSDs or HDDs?
3. Setup: What steps are involved in setting up a PCI-E SSD as an external drive? Are there any special considerations I should be aware of?
4. Reliability: Is using a PCI-E SSD externally a reliable long-term solution for data storage and transfer?

Any insights, recommendations, or experiences would be greatly appreciated! Thanks in advance for your help.

The original post: /r/datahoarder by /u/Wall_Naive on 2024-07-03 03:06:29.

Hello, im trying to expand my collection on old websites and looking though the internet archives there doesnt seem to be some .warc files of some old forums, like kongregates old forum. Do you guys have any archives/saved webpages of old forums?

The original post: /r/datahoarder by /u/massivlybored on 2024-07-03 01:20:57.

In the realm of the 10 thousand hours rule, I have been hoarding for years, and treat it like breathing, it is something I need to do to survive.

That being said, I do it for Podcasts I enjoy, Audiobooks, and TikTok accounts. The chances of me ever listening or watching all of them is slim to none, but I enjoy it so much that I don't have a way, currently of stopping.

The few horrible times I have had, thinking of what I could do, god forbid, if I was to lose everything on my Podcast external hard drive, or my TikTok hard drive, the things I could do with a free drive, but I don't want to because it is hard to justify why I am doing it.

Anyone else?

The original post: /r/datahoarder by /u/Outrageous-Front-868 on 2024-07-03 05:38:35.

https://www.techspot.com/news/103637-indonesia-government-data-centers-face-audit-after-cyberattack.html

Please donate some of your hardware to the goverment. *Facepalm*

The original post: /r/datahoarder by /u/Applewoood on 2024-07-03 05:26:16.

I have a Panasonic DMR-EH75V VCR / DVD combo and Funai ZV427FX4 VCR / DVD combo that work great for this purpose, but I would like more VCRS to speed up the digitization process. I know that JVC SVHS are capable of this, but SVHS are much more costly than the VCR / DVD combos. I've bought a few cheap combos just hoping that they'd record VHS through S Video, but get burned more often than not. Some say "DVD only" that of course don't work for VHS, but even some that don't say that aren't working out either. Is there a list somewhere of VCRs for S Video digitization? Or anyone know of a few thrifty models I could get? Thanks for any advice.

The original post: /r/datahoarder by /u/nothingveryobvious on 2024-07-03 04:03:21.

Saw a post earlier about this and was just wondering — why? Not at all in a judgmental way, more like, this sounds kind of interesting to me but idk what I’d use it for. I remember at one point spinning up ArchiveBox but then realizing I had no real use for it. Just want to get ideas. Thanks! :)

The original post: /r/datahoarder by /u/TheAbstractHero on 2024-07-03 02:54:11.

TL;DR 2x12TB RAID1 or 4x6TB RAID6?

Well, after parsing through the Datahoarder Wiki for an hour or two, I still feel lost as far as what disks I should purchase. The NAS will almost end up as a large catch-all for my data. Personal photos and videos, media libraries, (audio/video/pub). I've also begun saving a lot of content off the web to build out a local resource library for all things relevant to me. This is a rather new endeavor so my collection is quite small. I've currently got a 10 yr old 2TB disk, multiple full 64GB micro SDs, as well as roughly 500GB of data strewn about a few machines. I think a NAS somewhere around 10-12TB would give me adequate storage for a few years, while not being cost prohibitive.

The current plan is as follows:

mATX H310 board with an i3-8100T or i7-8700/8700T. I have the board and all three processors on hand.

The board is limited to four 6Gbs SATA connectors, one PCIE 3.0 x16, 2x PCIE-2 x1. Current plan is to find a 2.5GBe NIC for one of the X1 slots, leave the 3.0 X16 open.

What would r/DataHoarder recommend for an entry-level configuration?

The original post: /r/datahoarder by /u/kerimfriedman on 2024-07-03 02:44:27.

We are a small independent film company and we need to keep our film projects safe. We have local backup on a hard drive, but want the extra security of having an additional backup in the cloud. This is really just emergency, long term backup and will likely never be used, so we want it as cheap as possible while still being as reliable as possible. We already use Backblaze for the work we are currently doing, where we might actually need to restore a file from the cloud, but this request is about long term storage of previous projects that are no longer in production.

Having looked thorugh the forums one option I found is:

Amazon Glacier Deep Archive. It seems that this would cost about $1/TB/month. There would also be fees associated with backing up and then (if necessary) restoring those files - but since we hope never to actually need to restore from this backup, that is less of a concern. Still, for 12 TB of TB now (going up to 18 TB after this project is done) that is still a substantial fee. Also, it seems rather complicated.

As best I can tell, the easiest way to do this (for the non-technically savvy) is to use Arq Backup, though I couldn't find a guide for using Arq with Glacier Deep Archive.

I also have seen people refer to idrive e2 and wasabi as options, but the information there seems even more opaque.

A lot of the information I've found is over 2 years old, and it seems that there have been a lot of changes. Would love to have some more up-to-date information and suggestions. Thanks.

The original post: /r/datahoarder by /u/XargonWan on 2024-07-03 02:40:31.

The power gone for a few minutes, after the power came back the enclosure didn't turn on automatically, so my server couldn't mount the drives.

Do anyone got experience with this product? Is there any way to make it turn on automatically?

The original post: /r/datahoarder by /u/xphizio on 2024-07-03 01:45:15.

The idea has crossed my mind on providing IT services to clients by myself. I know the importance of backing up data. What is the best tool here in my case where I can show up to someones house or business, back their data up, then provide additional services?

I guess I should say cloud is the only option for me here as I don't want to be harboring tons of physical backups. I see rclone as an option to backup to cloud and utilize the terminal on each individual PC.

What does this sub think?

The original post: /r/datahoarder by /u/jammmmmmmmmmmm on 2024-07-02 23:40:41.

Any programs out there that can make the folder name copy the file name within the folder?

The original post: /r/datahoarder by /u/KarmaJGC on 2024-07-02 23:32:32.

Hey all! New here and new to wget! I am using wget to download the wiki's for BG3 and Elden Ring. I am in the Navy and will be gone for about 3 months with no internet connection and it will be nice to have wiki info available when I have some downtime to game.

With all that said, I am but a fledgling when it comes to command line prompts and I don't exactly have time to dive into learning to fully utilize wget. I found a post that showed the commands to enter to download Fextralife wiki's but the same command doesn't seem to work for bg3.wiki .

I downloaded https://eldenring.wiki.fextralife.com/Elden+Ring+Wiki with the command below, but when I tried to replace the url with the bg3.wiki it only downloaded index.html and all links don't work as the files aren't local.

Can anyone here give me the correct command to input to get the entire wiki from bg3.wiki? I am running it in Windows 10.

What I used for fextralife elden ring:

wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-names=windows --domains fextralife.com --no-parent eldenring.wiki.fextralife.com/Elden+Ring+Wiki

The original post: /r/datahoarder by /u/PaidinfullTks on 2024-07-02 23:13:22.