It's A Digital Disease!

The original post: /r/datahoarder by /u/freecrunchies on 2025-02-10 16:15:58.

My wife works in illustration and I work in written music, and we are looking for a solid backup solution for our files. I don’t have very large files, she has relatively big files, and all need to be backed up daily when we are working on our different projects, in case of computer crashing.

I use an external harddrive and keep a copy of all my scores in a cloud JIC (it’s pretty small).

She has a cloud but her computer is constantly full because I guess the cloud mirrors and is only as big as her computer? We still haven’t figured that out and she screams at her computer a lot. I fully support her in her screaming.

What is the best solution for backing up? After reading about this stuff it seems that the best solution would be the following:

Buy 2 big drives for her, 2 small ones for me. Keep 1 of each at home and the others at a friends house. Back up our work daily (when needed) on our respective drives. Mirror to our other drives every so often. In the time between mirrors, keep all new work backed up on a cloud JIC, to be deleted after mirroring.

Sound like a good system?

The original post: /r/datahoarder by /u/DowDef142 on 2025-02-10 15:54:32.

Hi, I have a question.

I have 100% of the most important things on my computer (as far as documents are concerned).

My backups currently look like this:

1. 300 GB folder of the most important documents > Macrium software backup (2 full copies and daily incremental ones). This set is synchronized with freefilesync to the HDD on the same computer.

Additionally, Qnap uses its software to make a copy of this folder along with the versions from the last 7 days (without creating an image, current synchronization).

From this HDD I also copy freefilesync to the QNAP server. (but as a macrium image). So in fact I have a copy on backblaze, an HDD in the form of a macrium image, a copy of the macrium image on QNAP and synchronization with versioning on Qnap (security if the macrium image is not possible to restore).

1. I make one full copy of the entire C drive (also with this 300 GB folder) and incremental copies (but only on the HDD drive without QNAP, due to its size of approx. 1.5 TB)
2. I have the entire computer connected to blackblaze personal
3. My onedrive and google workspace account backup in QNAP Server and local drive (marcium software).

I keep photos, videos that are also important to me in:

1. the HDD drive on the local computer

2. the Qnap server with RAID 1

3. the backblaze of the entire computer also contains them (after all, it has a copy of the local drive)

Is this generally sufficient?

The original post: /r/datahoarder by /u/slinnen on 2025-02-10 15:41:08.

Hi

In my opinion Storage spaces can be a headache when it comes to Parity, Columns and tiered storage. Does anyone have any suggestions on my build which has the following drives:

10 of 4TB HDD

2 of 1TB SSD

Mirroring is not needed, the data isn't super important but i'd like to be able to have at least 1 drive fail. Does anyone have any advice to maximize storage using Parity, Tiered Storage and the amount of Columns using the number of drives above?

My "goal" is to reach ~150 MB/s write and be able to lose at least 1 drive.

The original post: /r/datahoarder by /u/shad282 on 2025-02-10 14:41:02.

Hi everyone!

I'm looking to set up a NAS for my home to handle:

• Photo & media backups
• Home Assistant data storage
• Docker containers for apps & services
• Remote access for multiple users to upload/download files

I’ve been considering the Synology DS923+, as it seems to fit my needs. However, I feel like it’s a bit underpowered for the price, especially in terms of hardware.

I also looked into QNAP, but their history of security issues has me worried. I want something that is secure, reliable, and won’t need constant maintenance to stay protected.

Are there any better alternatives?

Would QNAP be safe with the right security setup (firewall, VPN, snapshots, etc.)?

Are there any custom NAS builds (TrueNAS, Unraid) that might be a better value?

Should I wait for upcoming synology models or look at used enterprise gear?

Thanks!

The original post: /r/datahoarder by /u/ArtIndustry on 2025-02-10 14:32:25.

Hi peeps

Is it possible that I shrink "E" partition and increase "C" (windows 10) partition by the same amount I shrink E? Both partitions are on the same Samsung EVO 970 NVMe.

Thx

The original post: /r/datahoarder by /u/FudgeComfortable3764 on 2025-02-10 13:45:09.

Hello,

Do you have any idear where I can get firmware for my Sun SL48 Tape library? It right now only supports firmware for LTO3 drives and not my (supported) LTO4 tape drive. Oracle does no longer provide access to the firmware files...

The original post: /r/datahoarder by /u/ELPoupa on 2025-02-10 13:58:21.

The original post: /r/datahoarder by /u/therewillbeniccage on 2025-02-10 10:24:06.

Trying to archive all my saved videos on facebook but it seems to be difficult to find something workable. Has anyone had any luck with this?

The original post: /r/datahoarder by /u/mrkevincooper on 2025-02-10 10:14:08.

I have a pretty large homelab (40 odd servers spanning about 25 years ftom old ML350 g4, Dell R610/620/630 etc through to DL360G10).

One from a datacentre decom is 12 bay supermicro X8 with 2x LSI megaraid 9260 4i running as a pair eith a mutiplex type backplane, L5640 CPU 12x 2TB sas 7.2k storage, 6 port Lagg/bonded ethernet, as a san/backup server that I previously used with esxi 6.7 (doesn't run esx 7+) and it had one VM of server 2022 as a fileserver basically to allow bios esxi boot abstracting the vm OS to allow a 16TB vmware disk ! This worked well but a crash/hard power off left the array unrecoverable (lost 10TB of CCTV footage) as the battery for the raid cache was dead.

That's since been fixed and pretty sure it won't have total raid corruption again (fingers crossed). I have a few R730s that are now storage servers for the CCTV and backups etc and basically I'm trying to ressurrect the supermicro X8 as an iscsi/nfs server for vmware shared storage with likely a 2TB os disk and 16TB store for migrating vs between hosts.

To avoid esx overhead and possible vmfs corruption again I've installed server 2019 direct but the old bios doesn't support UEFI boot so it can only use the first 2TB of the array.

I did a gpt2mbr conversion just now and it says I need to switch the bios to uefi mode or it will be unbootable ;) No UEFI bios is available (even normal bios updates involved direct chip read writes with a tool from another server with identical board!) Strangely it's allowed me to create a 16TB partition and it's working in its booted state.

So basically I'm considering splitting it into 2 arrays, 2TB mirrored boot drive and 16TB array for a iscsi or nfs share (probably what I should have done as it's a better practice :/ ) Would this work if the second array isn't a boot partition ?

I'm predominantly a Linux guy and going that route would work but again most modern distros are also preferring UEFI and have dropped LSI megaraid support so it's a bit of a faff with an older distro and loading drivers during install.

I also tried starwind iscsi server but that refuses to boot. Other options are crph or zfs but the odd multiplex lsi setup prevents flashing it to IT mode/lba as it'll likely only see 8 of the 12 disks if the cards are 'unpaired'.

At the end of the day I just want access to my 16TB fot vmware shared storage vm migration / backups etc rather than running actual vms on it. I'd imagine NFS would do just as well as iscsi for that. Nice to haves are cifs windows shares for the CCTV/ windows file server (Linux cifs performance is terrible for that, another reason I went server 2019)

So my question really, for anyone still awake after that lot, is what would you do with this antique thats still not bad for capacity and power usage ?

The original post: /r/datahoarder by /u/lern2swim on 2025-02-10 09:16:16.

Can anyone point me toward an nvme expansion card that will actually work with 4 drives? I've been using an Asus Hyper M.2 x16 card for 2 4tb drives, and need to expand, but it turns out that, with my mobo, I can only get it to recognize 2 drives, even if I put it in the 1st pcie slot and move my gpu down to the 2nd slot. I have a Ryzen 9 3900x on an Asus rog crosshair VIII hero.

The original post: /r/datahoarder by /u/RainOfPain125 on 2025-02-10 09:11:30.

Hello friends,

I'm trying to find a NAS purposed case that supports up to 8 drives, ATX motherboard, and hot swap drives. But it seems like they are all quite expensive - upwards of $200+ with stuff like the JONSBO N5 being a whopping $264.

I can't fathom how an array of HDD cages and SATA board would make it $150 more than a typical computer case. Surely their profit margins are massive with such an upsell such as this? Where is the market competition? And of course, do you have any recommendations?

I'm trying to take all the parts from my old build to create a multi-purpose NAS, opnsense, server-hosting, website-hosting, screen recording machine. But it seems a bit ridiculous to pay (for example) $264 for a case - something which quite frankly costs more than any other part in this build.

The original post: /r/datahoarder by /u/RealAmbassador4081 on 2025-02-10 07:26:44.

Sorry if this is not the proper place to ask.

Long story short the township I live in is making my life hell. They are passing by-law after by-law and blame people for not watching the YouTube meeting or watching the website. It's bullahit the website is a mess and the meetinge are also all over. I'm hopping I can put this all together properly and make my own site or have a site it can easily be accessed for the citizens with Transcript of all the meetings. This township is so corrupt the people need to know. I feel like I'm the only one that can with help.

Any help with this endeavor would be much appreciated.

The original post: /r/datahoarder by /u/deathstrawnote on 2025-02-10 06:51:27.

Is Cenmate 4 bay DAS a good option for storage, I am not looking in to NAS. Just want to store movies. Is there a compatibility HDD list for cenmate? I was not able to find compatibility HDD for the same. Regards

The original post: /r/datahoarder by /u/skwyckl on 2025-02-10 06:42:39.

For work, I frequently integrate search tools like Solr and ElasticSearch into enterprise applications and I myself have a Solr running on a server which auto-indexes the content of a self-hosted S3 bucket. I was wondering, however, if there was something more portable, for example a Solr-like application to run from a binary whenever needed on multiple machines? I need to organize 1000s of PDF files which I carry around with me everywhere I go, and I want to be safe in case my server crashes when I am away on a long(er) work trip.

The original post: /r/datahoarder by /u/harbourhunter on 2025-02-10 06:29:29.

So what are people using to download content these days? (insert steve buschemi meme)

The original post: /r/datahoarder by /u/tibbon on 2025-02-10 06:28:38.

I have around 10 USB Western Digital drives here, 12-18TB each. I was trying to use them for file shares, but they just weren't stable enough all sharing a few USB ports on my Intel Nuc, and I kept worrying about data loss.

I also have a Dell R820 server, which seems far more suitable to the task of being a killer NAS.

I'm thinking of getting a LSI 8300-8e or similar HBA controller with IT mode support, putting it in the R820, getting some SAS/SATA JBOD enclosure (EMC, Supermicro, etc) off eBay, and then shucking all of the Western Digital drives I have, and putting them into a ZFS (raid-z2) and making that a big file share mount. I have a full server rack that's only 1/3 full, so I don't mind a relatively large JBOD as long as it isn't terribly power inefficient.

I'm not doing a ton of high speed operations on it, except copying around files for video/audio editing, and perhaps watching movies from a Plex server or similar.

Does this plan likely work out? What difficulties am I going to encounter? Any suggestions on HBA cards or cheap JBODs?

The original post: /r/datahoarder by /u/InternalOcelot2855 on 2025-02-10 04:19:23.

I have some drives in the mail coming to me. It could be 2–3 weeks from now.

I also have some 6tb drives I can use to store some data till these drives come in. They are Western Digital SMR drives. What testing method can I do to ensure that the drives will not fail till the new ones come?

I understand it's a risk, hopefully nothing happens.

The original post: /r/datahoarder by /u/WH1PL4SH180 on 2025-02-10 03:53:07.

I recognize that spinny discs are the most cost effective methods of hoarding with good retrieval speed, however the power bills are big.

I'm currently running a moderate ausus store setup, but was thinking, are there any hybrid SSD/Disc setups that will allow a nas to pull torrents, keep a live directory index... And only wake the drives when necessary to save power?

Appreciate guidance.

The original post: /r/datahoarder by /u/RewanDemontay on 2025-02-10 03:04:46.

The original post: /r/datahoarder by /u/naughty_friedrice on 2025-02-10 01:33:31.

I want to buy some HDD just for storage, they can be new, used, refurbished, I just need them to be functional, reliable and cheap. Where do you guys buy yours?

The original post: /r/datahoarder by /u/rock2vapor on 2025-02-10 01:30:51.

I had a hard drive of photos and videos that I barely used, but suddenly not working. After some check disk and fixes, it somehow came back to life. I don't know how many files are now bad or dare to touch it.

So I looked into NAS with ZFS to see if I can have checksum and redundancy. That looks reasonably ok. I am in the process of building one. Maybe allowing 2 or 3 disk failures. That's a lot for low budget.

But then, I read that NAS and ZFS is not enough. One must back up. And that means doing 3-2-1, with 2 different types of media (one with back up tape and another with quantum mechanic j/k :-), and 2 are stores at different locations).

Seriously, that sounds good, but that would cost so much. What's your advice?

The original post: /r/datahoarder by /u/EncryptedEspresso on 2025-02-09 22:21:37.

The original post: /r/datahoarder by /u/benmarvin on 2025-02-09 22:19:33.

The original post: /r/datahoarder by /u/Electronic-Reading-5 on 2025-02-09 21:52:32.

Hi All,

 I am looking at some backup methods for my PC, and at the moment the easiest method for me is just copying and pasting large files and folders (studio and video editing sessions)  to a HDD (don't have great internet for cloud storage and can't consistently afford SSDs)

 At the moment, when I want to update the folders, I pretty much delete the entire HDD and copy across the whole parent folder again.

 There is the option to not delete and copy over the folder and it will only copy over new files and or as I understand, files that have changed.

 Does anybody know how effective this is?

 It can take up to 8 hours to copy over everything to one HDD but I am afraid that there will be files that have been updated but have the same name and file size, that won't get transferred across? Does windows have the ability to say, detect when a file was last updated and recognise that file?

 Is their any programs that can do this effectively?

 Thanks for any advice.

The original post: /r/datahoarder by /u/Anianna on 2025-02-09 20:48:11.

I've been reading the wiki and several posts here and what I've learned is that I have a lot to learn. I'm a little overwhelmed.

Is it possible to make a copy of a website to host on a local device or LAN in such a way that it functions as if it were connected save for being updated or linked to connected sites (as in, all of the links that go to pages within the site still function)?

For example, I'm interested in offline access to the "Preserve by" portions of the National Centers for Home Food Preservation ( https://nchfp.uga.edu/ ). Incidentally, yes, I know they have a book and, yes, I do have the latest edition. Is it possible for me to have an offline copy of this site that functions within its own pages the way it would online?

If this is possible, does this have a name I can use to search for more information?

Also, is there some beginners guide/for idiots book or website you could recommend for getting started on a path to data hoarding? The wiki is very informational, but it's a little above a starting point for a complete newbie.