It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
2001
 
 
The original post: /r/datahoarder by /u/Jacrava on 2025-04-16 18:39:36.
2002
 
 
The original post: /r/datahoarder by /u/Investcurious2024 on 2025-04-16 18:30:55.

So, I've looked into LG WP50NB40 writer, but Windows 10 or 11 aren't mentioned in the operating systems. Should I just find another one? And is it necessary to buy new writers everytime there comes a new windows version?

2003
 
 
The original post: /r/datahoarder by /u/John_Candy_Was_Dandy on 2025-04-16 18:19:47.
2004
 
 
The original post: /r/datahoarder by /u/HecateX on 2025-04-16 17:54:06.

By now that app is clearly abandoned, with issues piling up one after another.

Is there something that allows to download in an organized manner as that app did?

2005
 
 
The original post: /r/datahoarder by /u/TreverCarreon on 2025-04-16 17:27:22.

I'm a video editor putting together a storage solution for someone I work closely with. I'm very new to this larger-scale storage stuff. I do my editing off a working SSD currently and that's fine, I'm needing a significant and reliable backup to that that gets backed up to cloud.

After some research, I've landed on a QNAP RAID solution however, I need some help on specifics.

At first, I was going to go with a QNAP TR-004 populated with four 28 TB seagate drives using the QNAP hardware for a RAID 5 configuration, which would be backed up to a Backblaze personal plan.

HOWEVER, my client is wanting to have some future proofing. Would it make sense to jump up to a QNAP TVS-h474-PT-8G-US 4 Bay?

I was avoiding NAS because of the extra cost of backup however, I'm starting to have doubts about future proofing this setup.

could anyone help me figure out the advantages or have an alternate solution that might help?

EDIT: Also! Does anyone know if the TVS-h474-PT-8G-US 4 Bay shows up as a drive when connected via USB C like the 004 does? if that's the case could I still use it functionally as a DAS and keep Backblaze personal?

2006
 
 
The original post: /r/datahoarder by /u/Sinath_973 on 2025-04-16 16:06:31.

My goal is to scrape websites and extract their textual content to later use it in an AI context.

Currently i am working with n8n and you can scrape single urls, download their content and easily extract their content. But it seems very clunky to me and doesnt work with deeper nested pages. I would have to recousively go through links, filter for same domain and repeat the process for sub pages.

Do you have any better ideas?

I have checked for node.js libs to include in my n8n nodes but wasn't really convinced.

If someone knows a selfhostable scraper (docker preferred) with a clean API i would be super happy.

Cheers

2007
 
 
The original post: /r/datahoarder by /u/Delicious_Maize9656 on 2025-04-16 16:00:10.
2008
 
 
The original post: /r/datahoarder by /u/tongblack on 2025-04-16 15:47:34.

Hey, I am trying to create a brainless backup for my Photo/Video assets - I own a photo/video production company.

CURRENT SETUP

Windows PC

  • Internal working drive
  • Direct-attached QNAP RAID 5 box for longer-term storage
  • QNAP NAS on my home network for failure/redundancy
  • Backblaze for all my direct-attached storage (including the QNAP RAID box)

QNAP comes with a nice software (QSYNC) that creates a 2-way sync between my NAS and my RAID box, and that works great. Every time I add, remove, or modify any files/folders on my RAID box, the files automatically update on the NAS (and vice versa).

WHAT I WANT TO HAPPEN

When is start a new project, I create the folder structure on my internal Working drive and offload all my photos/videos to the working drive.

THEN, that structure is one-way synchronized to my RAID box (daily? hourly? doesn't have to be instant, but it does need to be automatic and regular).

THEN, QSYNC picks up the folder and does its usual 2-way sync thing between the RAID box and the NAS.

Yes, I can manually drop the folder structure from the Working Drive to RAID box - which is what I'm doing now - but as the project continues, there are usually subsequent iterations of edited files - so I'd like these to one-way sync to the RAID box automatically.

What apps/software will help me accomplish this?

Thanks!

2009
 
 
The original post: /r/datahoarder by /u/andrewsb8 on 2025-04-16 14:45:05.

Here is the link: https://archive.org/details/cvelistV5-main

The schema's are currently uploading. It's pretty small for now. This is in case the CWE site and the CVE github page both also go down. If the databases are continually updated I will try to update these periodically.

2010
 
 
The original post: /r/datahoarder by /u/cdmaster245 on 2025-04-16 14:31:00.

Hello all, I'm working with a team on a large project and the folks who created the project (in Europe) need to send my team (US) 500TB worth of data across the Atlantic. We looked into use AWS, but the cost is high. Any recommendations on going physical? Is 20TB the highest drives go nowadays? Option 2 would be about 25 drives, which seems excessive.

Edit - Thanks all for the suggestions. I'll bring all these options to my team and see what the move will be. You all gave us something to think about. Thanks again!

2011
2012
 
 
The original post: /r/datahoarder by /u/latencia on 2025-04-16 12:46:39.
2013
 
 
The original post: /r/datahoarder by /u/qwehhhjz on 2025-04-16 12:41:03.
2014
 
 
The original post: /r/datahoarder by /u/aloysius_black on 2025-04-16 12:37:40.
2015
 
 
The original post: /r/datahoarder by /u/th3rot10 on 2025-04-16 12:27:07.

I'm upgrading my NAS storage, debating between exos or iron wolf, they're the same price.

If both these drives are same price, same storage size and everything, which should I get?

I know exos is more enterprise, and iron wolf more hobbyist nas intended.

But it seems to suggest the exos has better quality.

Thoughts?

2016
 
 
The original post: /r/datahoarder by /u/noideawhatimdoing444 on 2025-04-16 12:26:09.
2017
 
 
The original post: /r/datahoarder by /u/Vividiant on 2025-04-16 10:34:18.

Here is my table for bitrate on movies and tv series. I had trouble finding the right sizes for easy storage and good quality. So here is my end result with experience and scrapping for info so you dont have to. Could be usefull to anyone.

1080P :

X264 AVC: 20-40 Mbps = 9-18 gb/h

X265 HEVC: 10-20 Mbps = 4,5-9 gb/h

4K :

X264 AVC: 40-100 Mbps = 18-45 gb/h

X265 HEVC: 30-60 Mbps = 13.5-27 gb/h

I would sugest to keep to 1080p most of the time. The difference isnt realy notisable unless you have a huge projector or tv. And get the 4k only for recent imax movies or such. 4K remasters or quite often poorly executed anyway so i would recomend sticking to the standard bluray release of older movies.

These's settings should look the same as a blu ray remux even at the lowest sugested settings.

I'll gladly modify these if anyone has propper sugestions but i hope to make a good and easy guide for anyone looking for help on the matter.

2018
 
 
The original post: /r/datahoarder by /u/crazymanisback on 2025-04-16 09:53:09.

We are a small team within a large European cloud provider, OVHcloud, currently rewriting the materials presenting our Cold Archive service.

Before we actually deploy this new presentation on our website, I would very interested on your expert eyes and constructive feedback on this page :

  • Do you think the product is made clear ?

  • Is there any key missing information ?

More generally, what would make you consider another Cold storage service/provider ?

Note that our main target is B2B, and do not hesitate to be frank, we of course value a lot the views of data hoarders :P

While I don't want to make this post an actual ad, do not hesitate to reach out in PM if you are interested in more details and/or want a free voucher (possible for companies and individuals pretty much anywhere in the world except USA at the moment unfortunately)

https://preview.redd.it/hg0ir76x56ve1.png?width=903&format=png&auto=webp&s=ac264c6ee4f79061f7812b6e71c437d6ac6b3b52

2019
 
 
The original post: /r/datahoarder by /u/TheRealHarrypm on 2025-04-16 09:17:54.

No it's not the end of the world...

Firstly as I have had 3 emails about this.. No there will be no price changes for the ADA4857 amplifyers or CX Card Clockgen Mod parts kits on the KoFi store, these prices are locked in the supply chain is locked and stocked in there is no effect.

Ok now for the situation with the DdD & MISRC, as these are direct manufacturing products, sadly these have been hit by the tariff effects and have doubled or tripled in total order costs for USA orders for people that make orders via PCBway etc.

The development boards for the DdD should not be affected as they are directly stocked in the USA, however I cannot say the same for the Tang Nano 20k used by the MISRC, MS2130 units are still relatively plentiful on the China markets and the margin really hasn't changed on those much.

In order to stem the bleeding of people thinking this all costs too much now, I will be directly producing the DdD & MISRC V1.5a and shipping them from the United Kingdom which means at worst you'll have if any an 10% tax, but still far cheaper than domestic North American fab orders.

So how I'm going to manage this? because I can't drop 3-10k out of the blue, so I'm going to do a 5 units pre-order cycle this means every 5 units ordered there will be a shipment if you want to order 5 whole units PM/DM me directly.

And yes this is also over 50USD+ cheeper then the eBay listing for the DdD as I am going as thin margin as possible on this offering but I offer shielded cases for those intrested, at a slight margin if I am being honest. (as long as my poor Ender 5 Pro can crank them out atleast lol)

2020
 
 
The original post: /r/datahoarder by /u/RogerRoger420 on 2025-04-16 08:04:26.

So I want to upgrade my NAS from 2x4TB (raid 1) to 2x20TB (raid 1). My 4K but small movie and show collection is in total about 4,5TB and I want enough future space because it's already expensive enough.

The problem lies that my NAS is in the living room. Dur to medical reasons my step dad sleeps in the livingroom and he already finds the clicking noise of my current drives annoying sometimes.

Current drives: WD RED PLUS 4TB

What would be the best drives to upgrade to for my situation?

2021
 
 
The original post: /r/datahoarder by /u/RacerKaiser on 2025-04-16 07:44:33.

When I first started hoarding, it was a matter of adding yt videos I watched and liked to a playlist, then downloading at the end of each month

Now, if it's a particularly obsure video, say a recording of a performance or an interview with an artist I like, I won't even watch it before downloading.

on the other hand I will specifically look for stuff, say a road test of a C63 l watched years ago, or a old pc video.

Put simply, do you look for hoarding material or just grab what you already watched?

2022
 
 
The original post: /r/datahoarder by /u/intelegant123 on 2025-04-16 06:21:21.

Hi - it's that time, my 9tb external hard drive is filling up and I want to build some redundancy in, so want to buy a 16tb.

Is it better to buy an enclosure and a 16tb swappable drive, or an off-the-shelf out of the box solution. Do not need NAS, as everything tuns through Plex and Caliber, but could think about a Raid/twin enclosure.

Thoughts?

2023
 
 
The original post: /r/datahoarder by /u/bathroomshy on 2025-04-16 04:06:17.

https://www.youtube.com/@TVsFenwick

this channel got two copyright strikes today and a third is inevitable. the owner does not plan to return to YouTube or reupload most videos if the channel is suspended, so save whatever you can. he's given everyone permission to mirror videos if it happens. there are around 2,000 videos on the channel including old commercials, emergency alerts, Weather Channel content, rare/obscure programs, etc

full playlist for anyone who wants to download the entire channel

2024
 
 
The original post: /r/datahoarder by /u/nostrademons on 2025-04-16 03:21:35.
2025
 
 
The original post: /r/datahoarder by /u/Unibrowser1 on 2025-04-16 02:40:50.

I was looking through the sub and saw some prepping talk which caught my interest. I was wondering if there are other uses/ideas for using HDD space. By the time im done adding drives to my server I'll have well over half a petabyte of usable space. Just wanted to poke around and see what else the community might be doing besides the obvious "Linux ISO" hoarding. Also feel free to tell all about the cool stuff you hoard for doomsday stuff like documents ect. I'm just curious to hear everyone's ideas.

view more: ‹ prev next ›