It's A Digital Disease!

The original post: /r/datahoarder by /u/The_Flo0r_is_Lava on 2025-01-18 23:08:00.

I currently have a DS2415+ with 12 10TB drives that's been going strong for almost 8 years now. I replaced smaller drives out with the 10TB drives about five years ago.

I am running up against the wall woth filling up the original and I'm planning on doing an upgrade.

I want to be able to run maybe 20 docker images on it.

I had considered replacing all the 10tb drives with 20tb drives but I quickly threw that idea in the garbage.

Is the new DS3622xs+ plus the drives worth the 7k? Is it powerful and reliable enough to run a docker setup?

Can you suggest any pros and cons?

EDIT: WHAT CARD WOULD YOU SUGGEST FOR A RAID ARRAY AND NOT WORRYING ABOUT THE COMPUTE?

The original post: /r/datahoarder by /u/TheCountofNotreDame on 2025-01-18 23:04:50.

Got into hoarding movies over a decade ago, and my server setup has evolved over the years like I'm sure most of yours has. Bought a Synology NAS in 2015 and that was good until I ran out of space in 2018. Bought another Synology NAS in 2019 and ran out of space with that one. Got into using the star apps in 2022 and man were those a game changer with the ability to streamline media organization through the use of hard links. I also got into using Kometa (used to be PMM) but was only able to get that working with my gaming PC, so when I ran out of space in my second Synology NAS I started using my gaming PC Fractal Meshify 2 case as a temporary HDD server in a windows storage pool (while still streaming media off my two Synology NASs on stored network drives). After a recent data loss scare with my windows storage pool and realizing I wouldn't be able to expand beyond 63 TB, I'm wondering where should I go next? Should I spend $2-3k on a server rack setup? Here are some things I'm hoping to accomplish:

1. Perma-seed with a hard links friendly setup - seems like the synology NAS file system thinks there is double the amount of usage even with a working hard link setup.
2. Use the starr apps in a user-friendly format such as windows. I'm able to do some light setup for things like Kometa in CMD/Powershell with a very detailed easy to follow guide but won't be able to invest time in things like Linux as I'm no programmer.
3. I want to continue to expand my capacity as I never want to make the hard choice of having to delete movies/tv shows, and would prefer not to have to buy the same size HDDs.
4. I want to move to the 3-2-1 setup for storage but would hope to consolidate the management of this in one system.

Here is my current setup:

https://preview.redd.it/ax28rekt2ude1.png?width=820&format=png&auto=webp&s=eb7f00d20eb85a7fd7e725bfecc4d7084813b51e

The original post: /r/datahoarder by /u/Agreeable-Taste-8448 on 2025-01-18 22:54:46.

Hey guys,

I'm buying an external harddrive for my partner. She studies digital design and needs one because all of the programs she uses don't fit on her laptop.

I've been eyeing these two. The Kingston is much smaller and lighter than the Samsung, but I honestly have no idea if there's a downside to that? I'm super grateful for your help.

Samsung: https://www.amazon.se/Samsung-T7-Portable-SSD-MU-PC1T0T/dp/B087DFLF9S

Kingston: https://www.dustinhome.se/product/5011350867/xs1000-portable-ssd-1tb?tab=specification

I was considering going with an HP flash drive instead, but I've seen people warn against using flash drives as opposed to external harddrives for running programs/gaming. Is that correct?

The original post: /r/datahoarder by /u/Trunks-kid on 2025-01-18 22:18:07.

Hey,

i want to download an Episode of a germant TV show, that my friend took part in it many years ago.He asked me if i could download it for him since it is available on stream right now and they might delete it in the future. The show is on RTL+. i was unable to Download it trying many different methods.I tried Screen recording with OBS, which doesnt work in fullscreen and in window mode. I tried downloading with JDownloader but it doesnt manage to grab the Link. I tried Downloading with the Chrome exstension VideoDownloadHelper but the Video comes out all buggy. I tried grabbing the link with the Chrome extenstion and then putting it into JDownloader but that doesnt work aswell.

At this point, im out of options and would aprreciate any help i can get.

Take care!

The original post: /r/datahoarder by /u/Barn0m on 2025-01-18 22:04:21.

I need a 1TB external SSD to edit videos and photos on my iPad. I've recently learned about NVMe, and it seems like I can buy a regular internal SSD and put it in a chassis to make it external? I'm not sure I'm understanding it correctly. I don't really understand what NVMe does or if it's necessary.

The original post: /r/datahoarder by /u/Shepherd-Boy on 2025-01-18 21:40:34.

Hey guys, I recently lost one of my matched HDDs that I used for my drive pool, thankfully I got a refund as it was in warranty (they didn't have any in stock to replace it). I have Stable Bit set to store two copies of everything. I decided to put two older drives into the pool that are big enough just to store the duplicate copies of files on the main harddrive as a fail safe. These two drives are a bit older though so I don't want stable bit to end up storing the two copies of anything on those two. I want EVERYTHING to either be saved to the main HDD or the SSD first and then duplicated to one of the older drives. Is there a way to set up Stable Bit Drive Pool to do this? I'm looking for some kind of "only use for duplicate files" box to check for the two older drives but no such thing seems to exist.

The original post: /r/datahoarder by /u/R3L__1990 on 2025-01-18 21:14:26.

I really need to get a grip on my backups and decide on a cloud provider as well, hoping you helpfull people can aid me with this.

My Unraid array is 104tb with a little over 80tb used, I am not looking to back all this up, the only thing I am worried about is family photos, RAW photos and footage, familys phone backups etc, this comes at the moment to a bit over 2tb. Whilst I would love to just backup all 80tb to another server I dont see the point in spending so much money on more drives, at least just now.

At the moment I have the data I truly care about on my array, I have resillio sync one way syncing the data to an external drive on another computer in the same home and I then have it also syncing to another unraid machine I built with a couple of drives in it to basically serve as a backup in another location.

So far how flawed is my logic? I feel like by using resillio sync I might be going down a slippery path but so far it has ran for a few months *knock on wood* without issue.

Is there anything else I could be doing to improve this locally? Is there another way I should sync the data at least locally in my home to the other external drive? Is there anything wrong with me syncing to the other machine in another location?

My next thought is that I am not truly following the 3-2-1 method, I also need a cloud backup, I have 1tb in Onedrive, and a family Google plan but I feel for this much data which will likely grow as time goes on I need something with more space, what would you guys recomend? I am based in the UK if that makes any difference.

2025 is the year I get my backups in order...hopefully  

The original post: /r/datahoarder by /u/the_cosworth on 2025-01-18 20:49:50.

Hi folks. Before kids and when I had lots of time, I had a fairly robust backup system on my home NAS. Life has gotten busy and I no longer maintain anything. So while I have most of my stuff off-line starting about 10 years ago. Here on forward I pretty much have everything stored either in Google Docs for spreadsheets and word documents and iCloud for photos. I tried searching and couldn't really see an exact answer to my question. I know how to offload everything but I'm wondering if people do? Do you offload your information from iCloud? Do you remove it from iCloud or do you keep it as a backup? Or do you not bother?

The original post: /r/datahoarder by /u/mossyskeleton on 2025-01-18 20:49:24.

I have years of journals that I have been meaning to back up in a digital format. I know in recent years there have been advances in searching handwriting, and I would like to utilize this.

My current thought is to just get a PDF-making app on my phone or iPad and start working my way through my journals.

Another idea I had was to use Google Keep and take photos of journal pages right in the app. (Google Keep allows you to search handwriting).

Does anyone have any other suggestions? What would you do for this?

The original post: /r/datahoarder by /u/Balance- on 2025-01-18 13:36:32.

The original post: /r/datahoarder by /u/vintologi24 on 2025-01-18 19:35:55.

I am collecting anime but i am running out of storage.

Interesting HDD option: WD Red Plus 12TB 7200rpm 256MB (242 $ + VAT)

I also have space for one more NVME SSD but i don't want to waste that on anything smaller than 8TB but 8TB SSDs are still overpriced.

I have avoided HDDs in the past due to concerns over noise but maybe if i find the right model that will not really be an issue?

The original post: /r/datahoarder by /u/POPSICLES01 on 2025-01-18 19:33:29.

Hey folks! I'm trying to get some better internal structure, safety and hygiene in my back up strategies. I am trying to better understand the most optimal approach to the 3-2-1 strategy in this case. I am considering adding Backblaze into this, but unsure if I should back up my computer, or my external hard drive to Backblaze.

MacBook Pro - Currently only doing backup regularly through a physical hard drive (+ integrate back up to Backblaze?)

External 2TB Hard drive - Containing music library, old photos, artist project files etc. Currently, I have a second hard drive that is a copy of the first. How can I keep this second hard drive an exact clone of the first one, without manually having to drag files between them? That it what I have done up until now. I want to have this second copy at home, since I travel a lot. The first one is always in my backpack, so I want a safe copy if the first should be stolen, damaged or corrupted.

Thanks in advance for your insights!

The original post: /r/datahoarder by /u/Eeemonts on 2025-01-18 19:16:42.

I know that there have been a number of posts on this subject, but I wanted to ask very specifically, just to be sure. I'm trying to access some songs that someone who is deceased posted on myspace many years ago. I know that myspace lost it all. Unfortunately, what I'm looking for isn't in the dragon hoard or internet archive. If what I'm looking for isn't there, am I just SoL, and that's it?

Thanks

The original post: /r/datahoarder by /u/X8ETr1x on 2025-01-18 19:14:56.

Current Scenario:

• I have about 14TB of data I can't replace (media, documents, code, etc.).
• I have a Framework 16 laptop running QubesOS.
• My primary storage systems are all network, but not portable (NAS, file server, etc.).

My goal:

• Have a light-weight two-bay DAS that I can take with me in an emergency.

Requirements:

• No cloud storage.
• Does not require a hardware RAID controller or - if it does - is a known reliable hardware RAID controller.
• Can use 3.5" spinning disks.
• Does not require OS-specific software to configure e.g. only runs on Windows.
• Uses USB-C.
• Likely to last at least two years before failure, longer obviously better.
• If a solution exists to meet all requirements, then budget is not a factor.

Essentially, if something occurs - such as a natural disaster - where I only have time to grab my go bag and a few small technology pieces, I want something that has some redundancy and a local copy of everything that I can easily access directly from my laptop. I won't be able to set up a small temporary network in my vehicle so even playing games with crossover cables is not something I want to do.

I've searched for hours and hours and get either mixed information or nothing at all, none of which applies to my specific use case. "Review" videos are all unboxing videos and don't say "after three years I've experienced X" so they haven't been helpful.

If anyone has any recommendations for a solution, I would greatly appreciate it. I've been looking at Synology, QNAP, Terramaster, etc. and everything seems to look shaky at best.

The original post: /r/datahoarder by /u/citelao on 2025-01-18 18:04:20.

I was looking up how to archive my favorite/bookmarked TikToks, and most tutorials needed me to export a JSON file of my usage, which takes a few days. I don't have time for that!

Instead, I used my browser's dev tools to get a list of my bookmarked TikToks, then threw that into yt-dlp. Seems to be working well so far (for my 300 bookmarks).

If you'd like, I wrote up my steps here: Download all your bookmarks from TikTok

The original post: /r/datahoarder by /u/AgreeableAd8687 on 2025-01-18 18:03:13.

I have a list of all my favorited sounds (about 500) and they are in the format https://m.tiktok.com/h5/share/music/7193016819606653702.html, yt-dlp doesnt allow me to download them, says ERROR: unsupported url and WARNING: [generic] Falling back on generic information extractor. how can i download all these sounds?

The original post: /r/datahoarder by /u/theswedishguy94 on 2025-01-18 17:57:56.

Hey DataHoarders,

I'm a documentary filmmaker with an ever-growing collection of footage that needs archiving. My situation:

Current data:

• Multiple documentary projects (raw footage, edits, masters)

• Around 15TB total currently

• Actively shooting new projects (hundreds of GB per shoot)

• Need reliable cold storage for completed projects

Currently considering:

• Used LTO drives (found LTO-4 for 180€)

• Large HDDs (found IronWolf 12TB for 155€)

My priorities:

• Cost-effective solution

• At least double backup

• Safe long-term storage

• Ability to scale as I shoot more

Budget is tight, but I need a reliable solution. Would love to hear your experiences and recommendations. Are there options I'm not considering? What would you do in my situation?

Thanks in advance!

The original post: /r/datahoarder by /u/TARANTULA_TIDDIES on 2025-01-18 17:41:17.

Basically the title. I wanted to back up my desktop. Has a 1tb drive that I've used most of. After finished making the image file, I see it's within 1gb of being the same size (maybe over?).

Am I doing something wrong or are there better tools to do this? Thanks all!

The original post: /r/datahoarder by /u/therealtimwarren on 2025-01-18 17:25:31.

I've read numerous posts on r/DataHoarder and r/homelab discussing backups and whether it is worthwhile getting into tape backups or sticking with HDD. Lots of opinion, but views differ on whether the cost is worthwhile.

So, I thought I'd have a quick go at working out the costs of both and making an easy comparison chart spreadsheet for you all to play with.

Enter the cost of your HDDs, Tape Drive, and Tapes along with the redundancy information the GREEN cells.

https://preview.redd.it/3pevisggdsde1.png?width=670&format=png&auto=webp&s=7eca9b495816579d849f09a866a8940eaba52974

Get pretty cost vs storage graph for both options.

https://preview.redd.it/xpdmiky2dsde1.png?width=1296&format=png&auto=webp&s=a426534d1821d1d4bd6dcbae162b7b2e9b4dd905

Link to Spreadsheet

The spreadsheet is view only example so you should download or make a copy of it so you can enter your own data.

Let me know if I've made any mistakes! This was thrown together just now. I'm tired. I'm hungry. I'm off for a Chinese takeaway... brb.

Enjoy!

The original post: /r/datahoarder by /u/Kamoooool on 2025-01-18 17:03:40.

Hello,

I'd like to setup Snapraid and MergerFS in my home server. I've got 2x 8TB Seagate Ironwolf drives and 3x 4TB WD Red drives.

Ironwolfs are in mint condition, and run great, but when it comes to WD Reds it's a different story.

The first one is perfectly fine, the second one has Curent_Pending_Sector count of 4 and Multi_Zone_Error_Rate of 111, the third one throws some errors in logs so I took it out of the server.

So how should I approach setup? I' want to utilize disks until their EOL.

I'm thinking about doing merge of 1x 8TB Ironwolf and 1x 4TB WD Red (the good one) and using these drives and Content + Data.

Then when it comes to parity data I'd like to go with the second Ironwolf and the second WD Red (One with pending sectors). Should I merge them or use them separately? Will there be any issue with the second parity drive being smaller?

What about the third drive? Should I use that or be worried about data corruption?

The original post: /r/datahoarder by /u/Handle_Just on 2025-01-18 16:46:41.

I’ve recently started at a small but growing production company that has all their media stored on about 150 hard drives scattered about the office. It’s complete chaos. Last week a drive broke, wasn't backed up (not my fault, I've just started there) and the footage was lost.

I’m new to complex media management (being, until now, a freelance editor) and am putting together a suggested package to solve the problem.

So far I’m stuck between getting a 4, 5 or 8 bay NAS. There will be a lot of large scale (4k) footage coming in over the next year - about 20 short docs worth - so my thinking is currently an 80TB, 8 bay NAS with 2 bay redundancy. Does this sound like the most sensible solution? Of course then top of that we’d need back up. I’m guessing this would need to be a second 60TB NAS/Raid in able to fully back up the first. I also don’t yet really know how to set up an offsite back up. I’m guessing this would mean investing in a third 60TB NAS externally connected to the first, via internet? Otherwise with footage constantly coming in, how can an offsite backup be kept up to date? Or should I be looking at cloud storage (i.e. Lucid) as the offsite backup?

This gets very expensive, very quickly, so I want to 100% make sure I’m putting together the correct recommendations before bringing it to the boss and suggesting they spend so much.

With internet download speeds of 100mbps in the office, I’m also not sure if this is fast enough to sustain all of this?

Any advice from someone more experience would be much appreciated! Many thanks.

The original post: /r/datahoarder by /u/scs3jb on 2025-01-18 13:58:51.

I found a few options but actually finding them at their RRP or below (or at all!) is a bit o a nightmare so I'm looking for some tips. I would need a SAS backplane (ideally expander) in the case so I can reduce the cabling and this is going to be JBOD. I currently have a 24-bay 4u X-Case eXtra Value 24 Bay, but a row of the backplane has started throwing errors and I've noticed that there are missing capacitors that may have been damaged. I have a JBOD / unraid setup and don't need anything even remotely fancy. I found some examples o 36-bay servers, but haven't found anyone selling just the chassis, trays and backplane:

• Chenbro RM41736 Plus
• SuperMicro SuperChassis 847E16-R1400LPB

The other option is just rack-mountable SAS expansion cages (1-4u) and I can cable externally to my LSI SAS cards. These are going into a rack.

I am based in Europe, mostly need something that doesn't cost a fortune and can be shipped to the UK (or Spain since that's the final destination)

The original post: /r/datahoarder by /u/Zooasaurus on 2025-01-18 12:05:15.

Hello, apologize for the newbie post, and if this is a very niche topic

Translations of the Turkish Oral Narrative Tales is a collection of more than two thousand digitized transcriptions of oral folktales from Turkey conducted in the 60s to the 80s. Is it possible for me to download every PDF of the transcriptions on that website without the hassle of downloading them one-by-one per page?

Mostly for personal reasons, but i am a bit afraid that it might be down later down the line and these important resources could no longer be accessed - not the first time it happened, the Ottoman Turkish page of the University of Michigan used to contain many important resources that are now gone

Any help is appreciated, thanks a lot

The original post: /r/datahoarder by /u/TestFlightBeta on 2025-01-18 11:24:18.

I want to keep my 2-disk and 6-disk JBOD in the balcony since the drives are way too loud to keep in my room. Conveniently, the router happens to be near the balcony.

I want to be able to access them as if they were connected via two USB cables to my Mac mini. What's the cheapest way to achieve this?

Here are some things I considered:

1. Very long USB cables. Unfortunately the cables would have to route through someone else's room to the balcony, so this is a no go.
2. Buying an 8-drive NAS and connecting it to the router directly. This option looks like it would run me $800-1500.

Is there nothing cheaper than this?

The original post: /r/datahoarder by /u/Bogdi504 on 2025-01-18 11:19:29.

I want to keep less than 1TB of photos and videos accesible for longer periods of time. Should I look for SSD or HDD? I have 1TB external HDD which is more than 10 years old. I have a backup on my computer but I want to keep all my photos and videos on a new storage. Any advice?