It's A Digital Disease!

The original post: /r/datahoarder by /u/Pale_Ad1658 on 2025-03-02 04:49:03.

So we are home brewers running on essentially our 1gbps speeds (some better who live in the concrete jungle) but have you ever run into an issue with your service provider from constantly using your download / upload at capacity for days/weeks on end.

I run a YouTube channel with 4 live streams and we demolition terabytes of monthly upload. I am on a first-name basis with the techs cause I notice when a hub goes down. After all, it affects our ability to stream.

The question is, do you feel like you are throttled in your pursuit to download the www in its entirety?

The original post: /r/datahoarder by /u/microcandella on 2025-03-02 03:03:05.

The original post: /r/datahoarder by /u/Crocudyle on 2025-03-02 02:10:40.

Hi!

Like the title suggest, I'm new in this sub and wanted to see if these data hoarders actually existed close by! I'd love to chat and collaborate with locals about the subject, so if you're close hit me up :)

As a bit of info on myself, I'm just getting started and my goal would be to set up some independent backup in these incertain times, and decentralize the power closer to where the people are. I'd like to help mirror Anna's archive with the few drives I have, or create a local group that does so

The original post: /r/datahoarder by /u/No_Can_5251 on 2025-03-02 00:48:22.

Hi - I've been copying our archived media to LTO for several months now, using Canister, without issues. Recently I discovered that one of the LTO tapes is not mounting, and in Canister it only says "Format", with no option to even "Repair" as it is greyed out. Yoyotta also does not recognize the tape as mounted.

We have it on our records that the tape copied 8.9TB successfully, via the transfer logs.

Has anyone had experience with this type of problem? mLogic support says that the index file may have been erased somehow, but don't know how to move forward from there. Any details or guidance helps. Thanks!

The original post: /r/datahoarder by /u/angrycatmeowmeow on 2025-03-02 00:43:06.

I've transferred two tb to it so far and it's not making any sad sounds or being weird. I was just gonna plug it into the USB on the DS923 and use hyper backup, but now I'm wondering if I should just shuck it as it seems the odds are in favor of it being an Exos or Iron Wolf branded as a Barracuda (my eyes are killing me from all the comments I've read). I have a DS220+ laying around collecting dust and it's only purpose would be backing up my DS923. I have two 20tb IWP and two 8tb IWP in the 923 and I'd love another 20tb in there, but not with this drive and I don't need the space yet. As a backup though? Seems like a win. I'd get to spool up a spare NAS I could maybe move off-site one day, and I'd get better monitoring as opposed to an external device, too.

The original post: /r/datahoarder by /u/Outrageous_Meat_867 on 2025-03-01 19:35:53.

When downloading a complete profile with all its Instagram posts using the instaloader tool, only the profile picture, a .JSON file, and an id file are downloaded, as shown below:

2024-10-28_13-34-56_UTC_profile_pic.jpg

usuario_53195964060.json.xz

id

I would like some help so that everything is downloaded—not just the profile picture, but all the posts—considering that the account to be downloaded is public and therefore does not require login.

The commands I used were: instaloader profile (account) and instaloader (account)."

The original post: /r/datahoarder by /u/Hits1015 on 2025-03-01 23:57:28.

I have multiple Macs and external HDs and SSDs containing years worth of media/data files which I need to review and organize.

This is a situation where i am using quicklook or "preview" to click and play files as fast as i can, to judge what's on them, relabel as needed and transfer each into one of several folders. File types are generally .wav/aif.mp3, .mp4 or .mov.

My strategy is to first copy all files to a main 'repository' drive, and go from there.

So...a lot of transfer back and forth, alot of very large volume folders with hundreds of files in them. And from there i'm dragging them into whatever category folder they belong in.

Speed isn't so much an issue as reliability and stability of the 'target' drive.

I'm looking at probably several terabytes of data.

One thought is that a NAS -grade HDD like a WD Red Plus 6TB might be good for archival storage of a large # of media files if it gives me much larger capacity at lower cost per TB, and is basically designed for reliability and long term storage.. and has proven long term retention characteristics.

That said, I may be way overthinking this. Is buying and using a spin drive particularly advantageous vs dedicating a solid SSD option? If the HDD makes sense, which external enclosure with a fan would be a good choice?

Otherwise same question about what SSD might be very reliable for this task, as well as an appropriate external enclosure recommendation for it?

The original post: /r/datahoarder by /u/whatisnuclear on 2025-03-01 23:07:54.

I'm a nuclear engineer and amateur reactor historian. The current and historical documents stored by the US Dept of Energy at osti.gov are incredibly valuable. We built all kinds of reactors back in the day and data and reports from them can help us understand their legacy and move forward intelligently. I'm personally worried that they may be taken offline at some point. Does anyone know of any archives/mirrors of this unique resource? Or have suggestions about how I might bulk download some of this?

The original post: /r/datahoarder by /u/asdf45df on 2025-03-01 22:13:49.

It's my first time setting up RAID with some old drives I had laying around, and I'm not sure if RAID 4 or 5 is the better option for me. I have four drives which are 1TB each. Three are 5200 RPM 3.5" laptop drives, and the fourth is a 7200 RPM WD Black 5.25".

Would it make more sense to go with RAID4 using the faster drive as the parity drive, or should I go with RAID5 and spread the parity blocks across all the drives?

The original post: /r/datahoarder by /u/intellidumb on 2025-03-01 20:16:50.

Just saw this new to me agency got disbanded. They have 1210 GitHub repos that may be relevant to the bigger government backup that wouldn’t be in the normal scope. These are also tools that others may find highly useful.

Story:

https://skywriter.blue/pages/did:plc:7vmqlqtvqkkmuegzp7efeptu/post/3ljd4swugvk26

The original post: /r/datahoarder by /u/It_Is1-24PM on 2025-03-01 20:08:59.

The original post: /r/datahoarder by /u/maevetoons on 2025-03-01 19:43:11.

The original post: /r/datahoarder by /u/PsychologicalBass738 on 2025-03-01 19:32:54.

I saw several people commented that it's important to have a proper backup for NAS and refer to the 3-2-1 strategy. So, it should be the original plus at least two backups, with one offsite backup right? That sounds like a lot of copies and redundancy. Is it actually necessary to have that many backups?

Let's say I have photos and files on my phone and laptop that automatically sync with my NAS, and I also have RAID set up as protection. Does that sound sufficient? Or should I actually strictly follow the 3-2-1 rule? If so, how should I back up my NAS then?

The original post: /r/datahoarder by /u/lenjioereh on 2025-03-01 19:28:10.

Hi,

I am wondering if anyone has the full snapshot of https://archive.org/details/pulpmagazinearchive ? If so is it avail for download somewhere? The reason I am asking because it would take me forever to download all those :(

The original post: /r/datahoarder by /u/Jazzlike_Hat9693 on 2025-03-01 18:49:27.

After doing a little research i'm leaning towards the Terramaster D4-320 4 bay DAS. I have a decent laptop that I plan to keep on all the time and connected to the DAS. I chose this unit for its good price vs higher end units like Synology and general good reviews on its hardware and software. I also looked at some non-name brand 4 bay enclosures and stuff like QNAP, and the general consensus of what I read it's it requires more technical knowledge and maintenance. I am okay technically but since this is my first unit I'd like it to be somewhat streamlined so I can fully experience what it can do and get a feel for what I might want in the future without having to worry about maintenence type issues. I'm open to other recommendations as well.

I'm wondering if this model will meet my needs/wants listed below, and also what things may come up in the future that I'm not I'm not yet aware of that might require me to get an upgrade

My current main needs/wants are:

1. Better storage solution other than my current solution of loose SSDs that I swap in and out of an powered adapter.

2. Cloud access for documents with good security accessible within my home network. I'd like to be able to stream videos to my TV as well but that's low priority

3. Cloud access for files from my phone or devices remotely. Possibly link Google photos from my phone to back up to the drive. For this, security is important to me

Bonus items:

1. Plex server, stream 4k videos both in my home network and remotely. Possibly be able to share a real debrid account
2. For the cloud access, I'd like to be able to grant family members access to their own designated partition or folder on the drive that they can access from their cell phones and devices. But have this be separate and not have to worry about them accessing my personal files. Maybe set up account/login for them to access that I can send them an email to set up

Thanks in advance for the input!

The original post: /r/datahoarder by /u/Soliloquy789 on 2025-03-01 17:25:12.

I think my husband just isn't doing the math right. We have a 96TB NAS spread out over 7 HDD. I was planning out upgrades and asked how much the server costs is in electricity a month. He added some things up and said 15$. However, I constantly see people in here saying that their servers are too expensive. So so does that seem to low?

The original post: /r/datahoarder by /u/skaertus on 2025-03-01 17:03:48.

I bought an Orico DS500-C3 and a 18 TB HDD to use it with. It did not work.

I was told, by the seller of the Orico, that my recently bought HDD was incompatible with the device. It is a Seagate IronWolf Pro, and, because it is for NAS, it is incompatible.

I am, of course, very disappointed at this. I am trying to return the HDD (which is not an easy task, as I live in Brazil and sellers are usually unwilling to receive products back).

I am also thinking whether I should just return the Orico and buy a larger external HDD (24 TB is the maximum I could find here) or if I should try another HDD. But this time I would like one that is fully compatible.

Any recommendation on what to do?

The original post: /r/datahoarder by /u/mobo2015 on 2025-03-01 16:24:50.

Previously I used sites like fsave.io but now it doesn't work and other sites. How do I currently download private videos and reels that I have access to?

The original post: /r/datahoarder by /u/researchplaceholder on 2025-03-01 14:58:15.

Hi, if this is not the right place to post, please let me know where to ask if not here. I asked on the r/techsupport Discord server and it hasn't gone anywhere.

I want to download public Facebook posts and comments (and comment replies) as a PDF for offline analysis for my research. (I'm one of the people analyzing the extremists in the NYTimes comment section).

Last year, I could do this in Safari by going to the direct post link and then clicking Export as PDF. However, Facebook changed their UI so now it only captures what's visible on my screen as a PDF.

Taking multiple screenshots of a single post and stitching them together is really difficult when I'm analyzing hundreds of posts. This is the same problem with taking a video while scrolling, I have to stitch together individual frames and it seems like there should be a better way.

Taking a screen shots (even of the full page in Firefox) now only captures what's visible. And even if I'm zoomed out all the way, it's not capturing all the comments.

Scraping is not an option for me, because I need to analyze the visual elements (like the images/profile pictures/emojis) that API scrapers don't pull.

I need to see the comment replies as well as the comments, which aren't visible on one page on mobile.

I was really hoping y'all had a good method you could share. Really, really hoping. I'm open to ideas. I feel like I've tried everything.

The original post: /r/datahoarder by /u/FairLoser on 2025-03-01 16:03:02.

Due to the way WB manufactured their DVDs, virtually all discs pressed between 2006-8 are unplayable now.

The original post: /r/datahoarder by /u/BobbythebreinHeenan on 2025-03-01 15:37:07.

The original post: /r/datahoarder by /u/Deep-Egg-6167 on 2025-03-01 14:58:30.

Hello,

I have a PERC h755 in my Windows 11 x64 24H2 PC. I've used LSI cards in the past (on windows 8, 10 and 11) but had a hard time finding the software that works with this card.

I'm using LSA 4.134. It says I have x number of disks but I don't see where it identifies each disk, just the total. Any guess how to get there? Am I using the wrong software. I cannot do it in the bios so it will have to be in Windows.

The original post: /r/datahoarder by /u/QualitySound96 on 2025-03-01 13:54:07.

1 mechanical drive and one SSD drive

The original post: /r/datahoarder by /u/redditunderground1 on 2025-03-01 13:37:09.

https://preview.redd.it/v2i9q6ufy2me1.png?width=2736&format=png&auto=webp&s=1d7f21492dd50f98bc589797284c4749a71185e6

30-month Samsung T7 SSD archival test complete. All data on drive is fine.

Next test 3.1.26 / 42 months.

The original post: /r/datahoarder by /u/pilioko on 2025-03-01 12:39:34.

Easiest way to assign numbers to photos in a folder using its metadata. This is both for the way i want the photos to be organized in viewer, but also for assigning which photos comes first in a set of photos.

Preferably something more specific than date or time of modification.