It's A Digital Disease!

The original post: /r/datahoarder by /u/boyididit on 2024-07-10 12:55:42.

So I had a hdd crash and never want it to happen again

And cost effective solutions to prevent data loss ? Software for this?

The original post: /r/datahoarder by /u/Apptryiguess on 2024-07-10 12:44:10.

Well technically 18TB, not 20TB. Regardless, i have a bunch of media that fall into only 3 folder:

• Movies
• Tv Shows
• Anime

Is it ok to distribute 18TB on only these 3 folders? I have been doing it for a while and haven't come across any problems, but recently read some reddit threads that suggested that might not be a good idea.

The original post: /r/datahoarder by /u/fjavoj on 2024-07-10 12:33:05.

Hello to all.

i will be happy if you know solution for this problem.

I have WD My Book 4TB and have set an automatic backup every week...whats wrong is that i cannont open those files in windows explorer or even Bridge...

There is just blue icons of backups and if i click on them it open original folder on my hardrive in PC.

Soo the problem is that i cannon open those backup folders and files, what iam doing wrong

https://preview.redd.it/5ackr1m4robd1.png?width=1416&format=png&auto=webp&s=f54e139fb7c9b777c0b2213e17a696abd66ee107

The original post: /r/datahoarder by /u/YousureWannaknow on 2024-07-10 11:11:11.

I mean, I came to you with quite noon question, but it's not really tech related.. Rather hoarding absurd.. And yes, I hoard whatever I can, not only data, still, keeping physical stuff is quite less time consuming, than data (despite huge issue i have with humidity, I can't get it settled around 45%).

Still, I managed to save enough to make purchase of backup drive for my storage. Main storage till this time was exFAT 16tb external drive from Seagate Expansion Hub line, I'm quite happy with it (before I got backup drive it barley ever worked longer than 8hours per one power on)., Bought another one, e Set it up with ext4 filesystem and decided to copy everything over using Grsync (basically GUI tool for rsync).. I know i used quite old business notebook for it, but transfer was around 14 MB/s, so theoretically it shouldn't take longer to move 5,6Tb from one to another than 5 days.. Took a bit over 6 😂 and It didn't made or checked md5sum files.. Now I'm making checksum files on my first drive, since while checking file sizes on drives, one with ext4 gave information, that some of drives weren't readable (whatever that means).. It's getting close to 36 hours and it still have about 10 thousand files to process.. And I thought that it will take no longer than 8 hours to check all 46 thousands.. Oh, I should mention that also rhash gives prompts about "wrong embeded crc32" in some files, but don't list which..

So.. For future, guys, if you want to grab some backups, make a lot of patience and free time for it 🤣 But also, if you know what these prompts it gave me, meant or just want to tell me how stupid i was to believe rough calculations, feel free to do it..

Sorry I just wanted to share it with you

The original post: /r/datahoarder by /u/apouche on 2024-07-10 10:08:16.

Hello Hoarders, I want to get started into blu-ray ripping but feel a bit lost in terms of software availibity to do so. I have the following requirements:

• All piece of software should be legal, they can be free or paid I don't mind as long as it's legal
• RIP all blu-ray content including latest movies
• Compression format/settings should preserve quality as much as possible
• Compress 4k movies
• I will only rip movies, no TV-Shows

From my current research the consensus is:

• MakeMKV for ripping
• Handbrake for compression

Is that the case and if yes could you guys share your tips and settings ?

The original post: /r/datahoarder by /u/imonlyhereforpizza on 2024-07-10 09:56:56.

I'm running a home server which is completely 12V powered by one 100w power brick. Unfortunately due to bad installation the electricity is not very reliable so I'd like to add a small UPS in case of a short power interruption. I also want the UPS to gracefully shutdown my server when the battery capacity is reaching low levels. However all the UPS I found capable of doing so are either 12V but low wattage and no graceful shutdown or AC-Inverters which is completely unneccessary in my setup.

Does anyone know of a UPS which can suppy 12V with at least 100W and is capable of gracefully shutdown my hardware. The capacity of the battery and the duration of backup power is not very important to me. It's more about the graceful shutdown.

The original post: /r/datahoarder by /u/nbtm_sh on 2024-07-10 07:49:39.

The original post: /r/datahoarder by /u/PowerUser00 on 2024-07-10 01:30:56.

Currently specing out a NAS and I'd like to get a bit of a sanity check on my idea for it. Here's the plan:

• bcachefs with 3x14tb hdds with replicas=3 (so I can lose 2 disks), and a 1tb ssd as a cache drive
• nfs and smb as options to access files from my personal ("main") folder structure
• various services like nextcloud, immich, and jellyfin with data stored in their own locations outside of the main folders
  • jellyfin will likely read my music library from a folder somewhere in the main folder structure
  • nextcloud for its nice apps (todo, calendar, notes)
    • not 100% sure how to integrate the actual cloud storage part of nc. maybe it could be something like another frontend for my main storage, like nfs and smb? I'd like to consolidate the places I keep things if possible.
• no plan for off-site backup yet, although considering crashplan as an option for this
• remote access through tailscale or other mesh network
• hardware is raspberry pi 4b
  • I've used this as my server for a while. It runs nextcloud and jellyfin fine. Not sure about immich yet.
• OS is NixOS

Is there anything I didn't mention here that I should consider before I go ahead with this? Any tips from other NAS owners? Favorite data hoarding services I should run? Any feedback is appreciated!

The original post: /r/datahoarder by /u/A5623 on 2024-07-10 01:26:34.

I have an Android phone that I mainly use as a music player. It have a microSD card and I do backup the data every week to an external drive but I am worried that a file get curropted by bitrot (not being read/written) for a long time, and then I backup the corrupted file.

What is the best way to prevent bitrot in my situation?

The problem with bitrot is that, the curropted data is backedup and with enough time the backup will be replaced by another. So what is the best solution?

Please keep in mind, that I am intellectually challanged, I need a detailed explanation to understand things.

The original post: /r/datahoarder by /u/Fabulous-Lack-1019 on 2024-07-09 23:27:38.

Generally what has a longer lifespan for whatever storage option you transfer items on. I’m super paranoid about my stuff breaking since I’m clumsy and careless. I try to keep a small backup in the form of flash drives since my budget is low.

Storage options like a portable SSD, HDD, flash drive, Micro SD CHIP (think the one that Samsung tablets used). That’s all I can think of. What’s a better way to prevent any of these from breaking down or smth going run?

As a student, digital artist, writer and gamer I've started using cloud based options but it never hurts to use one portable SSD to leave at home or a flashdrive on the go.

What would typically last longer? I know portable SSD aren't going to last forever if you keep filling it up (reading and writing files by dragging them when ur transferring them to anothet backup and so on).

Plus ibe heard people say certain brands like Sandisk corrups the data

The original post: /r/datahoarder by /u/Charcookiecumbs on 2024-07-09 22:46:41.

I’m trying to make an archive of the artists I like on twitter.

The issue is that I have followed over 3k people over the years, so trying to find the ones I like a is hard, specially if their account isn’t English .

And I’ve bookmarked every post I intended to download later, and now countless bookmarks have piled up.

What would you suggest me to do tidy up this mess ?

I’m kinda stuck finding out what tool can help me bulk download tweets without risks. Also, is there a way to download all bookmarks?

An off topic question, but what tool would you suggest for instant screenshots on Firefox ? I wanted to screenshot each bookmark before downloading it to have access to the artist’s name

The original post: /r/datahoarder by /u/GreatGizmo744 on 2024-07-09 21:01:16.

Absolute first beginner here. I just set up my first NAS (Using the term very loosely here, it's just a hard drive connected via USB to my router) and got it all working correctly, surprising for me as I do not know ANYTHING about networking at all and that's why I hope you can help.

I wondered if someone could help me set up a system that allows Me full access to the drive but My friend who is on the same network only has some access to the drive and it blocks certain folders for him.

Just thought I would include this. This is all I have to work with.

I tried my best to get it to work but I had no success and in every video I try and look up the UI of the rougher always looks different to what I'm doing.

I apologist if this is the wrong Subreddit. Thanks all!

The original post: /r/datahoarder by /u/UnKoLegen on 2024-07-09 20:28:08.

looking for a working wayback machine alternative now that it's gone

The original post: /r/datahoarder by /u/allthemolecules on 2024-07-09 18:40:20.

I'm not looking to be a "data hoarder" per se, but I trust y'all's perspective.

Problem

I started a Plex server/*arr stack on an unused M1 Mac Mini a year ago, and for the most part it's been grand: no problems with transcoding or running a ton of Docker containers. The performance-per-watt of the M1 is incredible, and the main reason I've been attached to it as a server. There are some quirks and limitations of macOS, but I've gotten things mostly pretty stable.

The weak point is getting to be my storage setup. I have a 12TB 3.5" WD Elements external that has been very flaky, and the 5TB 2.5" external I had before was as well.

I deal with random and frequent disconnections, and worry about eventual data corruption. I don't know if it's the stock enclosure, a configuration issue that's increasing disk wear, the macOS USB controller, or what.

I'm also at ~70% capacity, and need to think about that as well. (I could probably make ~32TB last awhile, since I mostly do 720p/1080p media).

Options

As I see it, attempting to optimize for storage stability, storage space, future-proofing, and cost, I'm looking at the following options:

1. Shuck the 12TB into a new enclosure to buy a bit more time. (cheap, bandaid)
2. Shuck the 12TB into a 2- or 4-bay DAS and add drives over time, eventually moving to RAID. (cheapish, but will it fix my problems?)
3. Get a low-power 2- or 4-bay NAS and either DAS it or throw it in a closet with ethernet. (pricier, but doable if it'll fix my problems)
4. Get a transcode-capable 2- or 4-bay Intel NAS, move the stack over, and decommission the Mac. (much pricier and a little sad, but I can recoup some cost by selling the Mac. my main concerns would be power usage and initial expense)
5. DIY a low-power, high-performance NAS with unRAID and decommission the Mac. (I worry about stability of a DIY solution, as well as wondering if I just ran in circles compared to the M1 Mac + DAS approach)
6. Something else I haven't thought of.

I know the fun thing is to shit on Macs, but I'm really pretty fine with macOS and love the M1, though I know a Linux setup would probably be more stable for my use case. I'd gladly entertain being pushed in that direction as long as I knew it wasn't automatically coming from a Mac-hate place.

Budget

My budget... I dunno. Probably $300-400 to make the problem go away now, and invest more over time. I'd prefer to only spend near the upper end of that range (and especially more) if I can replace my Mac outright. I've been looking at Synology 220+, 224+, 420+, and similar.

Thoughts?

The original post: /r/datahoarder by /u/Puzzleheaded-Sea1553 on 2024-07-09 18:33:34.

I primarily use IDM because it's faster, but before that I used JDownloader 2, and yesterday it seemed to be working fine, but now neither of them are working, specifically with YT. I tried downloading from other sites like Vimeo, as well as random tube sites, and those still work, so it's definitely a YT issue.

I figure this is either server related, or they're once again attempting to block external downloading, which, hopefully software updates will eventually get around, but idk.

I also tried Video DownloadHelper for Firefox and oddly enough that seems to work (at least for now), however it's slow as ever and leaves a watermark, so obviously prefer not to use it. Anyone have any workarounds or alternatives in the meantime?

UPDATE: JDownloader just released an update within the past hour between 1-2 PST to fix the issue. Unsure about IDM.

The original post: /r/datahoarder by /u/t0mserv0 on 2024-07-09 18:22:59.

Trying to view a video of one of my fav band's songs, but the video is unavailable/unlisted on their channel. However it has still been uploaded there... I can see the video thumbnail and the length, just unviewable because it's unlisted and unavailable. Any way to get around this?

The original post: /r/datahoarder by /u/DropzBanger on 2024-07-09 17:40:02.

There must have been an update that fixed the previous methods:

PC web: F12, ctrl+F, search "blob", select the last one, open link in new window, download it

Android phone: search it in cache and copy it to an another place

So these are no longer working for me.

What are your experiences with it?

Did somebody find a new way?

The original post: /r/datahoarder by /u/BenK_711 on 2024-07-09 16:50:31.

Hello

I'm not sure if I'm here in the right sub. What I'm looking for is a tool, which Scans the content of my book and document library in pdf and epub, mobi format. Then I wanna be able to search within the content by keywords, or even questions, if there is something like an AI engine.

Any suggestions?

The original post: /r/datahoarder by /u/crick_in_my_neck on 2024-07-09 14:10:19.

I back up my computer's two disks by creating an image/incrementals with Macrium Reflect and putting them on external drives. Twice a year or so I switch those out with ones in a safe deposit box. In case of earthquake or fire or whatever (the bank is not far) I would like the ability to create a full restore from the cloud as well (for the main drive--the other drive is just file storage). It's proving more difficult than I thought. Backblaze and IDrive get poor marks for actually saving all of the files you think they are saving, and while IDrive offers a physical disk to restore from (EDIT: BB does as well, actually), one person said it took over a month to get 1.5TB of data from them this way. I've thought of uploading my Macrium images somewhere for the sake of simplicity but it would take 3 days every week to upload a fresh image. If I uploaded one image for restore and then just did the regular IDrive/Backblaze backup process in addition from then on (instead of incrementals for that specific image) I would still face the issue of not knowing if everything was truly saved like other people have found (also don't like the accumulating versions of files and this would end up with me getting gouged for overages or paying for twice what I need). I figure the Disk Clone feature might solve at least the problem of knowing if files were backed up since it is (theoretically) the whole image, but it has no feedback or reviews at all anywhere. This is also true for IDrive Mirror, which is cheaper and appears just meant for this alone: https://www.idrivemirror.com, but appears to be even more obscure and unknown. None of this solves IDrive potentially slow-walking a recovery disk in case of catastrophe, but at least that would be something if it existed and was coming eventually.

I don't want to pay for a service and find out too late like many people seem to that it doesn't have my info when it counts. Has anyone used IDrive's Mirror or Disk Clone offerings? I don't have a spare computer to test recovery on with a trial...Thanks. Any alternate suggestions to my needs (full bare-metal restore from cloud for about 1TB for my regular drive, and another drive of files that can just be saved regularly at 3.25TB) would be most welcome.

The original post: /r/datahoarder by /u/Blackirean on 2024-07-09 13:30:42.

I have dozens of terabytes of data in a media library I want to safe keep. My hard drives are nice but I was looking for something longer lasting, that didn't occupy too much space and where I could keep the files and copy them to a new drive if the HDD I keep in my desk were to fail.

Someone here pointed towards magnetic tape, at first I thought it felt archaic but then I saw some tape drives that could hold up to 45TB compressed or 18TB lossless for the LTO-9 with some decent write and read speeds. Each at a somewhat reasonable price. Plus the fact they apparently can last for quite a while.

But then I looked into the actual drives to read or write the tapes and I almost fell off my chair at the prices. Going for several thousand dollars at best, some even more than 10k

I just did some preliminary search so I could be missing something but it seems these are for enterprise use, and my use would be purely personal. To use with a normal windows PC.

Are there any cheaper options to get into magnetic tape? Thus far I would only need 1 or 2 tape drives to hold my data, but that of course can change.

Or should I give up and try to use something like M-disks or some other optical disk archival tech and simply keep the data in a (possibly very tall) disc stack?

The original post: /r/datahoarder by /u/xFruitPunchSamurai on 2024-07-09 07:17:44.

Hi, I am planning to buy an 5TB segate one touch for primary purpose of torrenting and jellyfin (direct play) server. As I will be using it for private tracker it would be idling most of the time and it will be on 24/7 Will the said disk last decent like 5+ years for my case ?? I don't care much about speed. I know 3.5" inch NAS drive are better suited but i am using old laptop so connecting and powering up hdd in case of power outrage is hassel to deal with for me.

The original post: /r/datahoarder by /u/MrAcademics on 2024-07-09 12:07:32.

Hello all, could I please seek your help with some recommendations for:

a) a method of automatic, scheduled backing up a 4TB Windows disk (disk mage basically that I can restore from) via a local network drive

b) remotely backing up said disk image across the internet to eg a Synology NAS via an auto schedule

Apologies for the demanding question. Any help would be most appreciated

The original post: /r/datahoarder by /u/Dish_Melodic on 2024-07-09 11:46:07.

I got HDD replacement from Supermicro. HDD Sentinel shows:

Power on hour: 0 hour. Start/stop count: 13000.

HDD does not show any issues, but I wondered how a fairly new HDD has start stop count of 13000? Or is it a bug in HD sentinel?

The original post: /r/datahoarder by /u/Empty-Language-8593 on 2024-07-09 11:44:18.

Hello all,

Sorry if this is the wrong place to ask about this.

I have a severe neurological condition that leaves me housebound and very physically limited (etc etc)

So I wanted to start a niche project and after years of thinking that’s what I came up with.

Any ideas anyone about where I could actually go about finding said data? I mean, if it’s online it’s basically already been done, so it would have to be physical that I could then go and do myself.

I’ve had a look on eBay and can’t find much. Any help would be appreciated.

I guess into be looking for stuff from like 50s, 60s and 70s? Not too old nor too new. Earlier is fine if legible enough.

Thanks!

The original post: /r/datahoarder by /u/DarthShitonium on 2024-07-09 10:25:36.

I'm planning to gather multiple terabytes of repacks to unpack and install for a personal collection. This project will probably take months, with almost 24/7 read and write operations. So, my question is: would an HDD for NAS setups, like the WD Purple or Red, be good for this? I've read they're durable and perfect for this kind of thing. I'm hoping the drives will last at least five years.

And yes, I’ll be seeding.