It's A Digital Disease!

The original post: /r/datahoarder by /u/grilkshake on 2024-12-05 01:17:20.

i have no background in coding or computer science this is so overwhelming help PLEASE. im talking about the GitHub project "bulk downloader for reddit" or BDFR. there are so many posts on here about how great it is but i can't for the life of me figure it out.

The original post: /r/datahoarder by /u/ZooterTheWooter on 2024-12-05 00:26:56.

Sometimes if I try downloading a webp video off gelbooru the file will corrupt and won't let me watch it on desktop.

I think its a bug with the embedding, are there any applications that will let me download gelbooru videos without any issue? I tried iTubeGo but that didn't work.

The original post: /r/datahoarder by /u/cadillac_warlock on 2024-12-05 00:13:45.

I need a way to download an enitre of playlist of videos from youtube. Im prepared to run dedicated software or create scripts for the task. Just need to be pointed in the write direction. Just trying to streamline my youtube hoarding workflow

The original post: /r/datahoarder by /u/LaGrande-Gwaz on 2024-12-05 00:01:01.

The original post: /r/datahoarder by /u/Watcher-World on 2024-12-04 23:48:14.

I bought a Kingston 2TB external SSD. Both my Win11 PC and my Raspberry Pi 5 (Raspbian) detected it as a HDD. Is this always the case for all external SSD?

It is my understanding that TRIM is unavailable for HDD. So, if my external SSD is detected as HDD, then TRIM will not be available. I think at the very least write performance will deteriorate. Also, will the longevity of the SSD be shortened?

The original post: /r/datahoarder by /u/LowCorner9314 on 2024-12-04 23:35:56.

Interested to hear about your CD ripping workflows?

I'm in the process of converting and old duplicator into a small ripping station and would like it to be headless so was looking to use whipper.

If I end up using a screen, I may as well stick with dbPoweramp.

I use Roon for my library which handles loads of metadata about CD providing its tagged correctly in the first place.

If I can get a little 2x16 LCD showing progress of two drives too, awesome, doubt anyone has bothered already though.

The original post: /r/datahoarder by /u/Halos-117 on 2024-12-04 23:19:58.

My setup is pretty simple: 2 x 18TB drives each in a separate USB enclosure. The 2nd drive is meant to be a mirror of the 1st drive for backup purposes.

Right now my backup process is this: I add files to the first drive as I go then at some point I'll hook up the 2nd drive and copy paste all of the new data to try and keep both drives in sync. As I keep adding more, it is getting difficult to remember what should be copied over to the 2nd drive. Is there any software that can make this backup process easier?

I'm on Windows if that matters.

The original post: /r/datahoarder by /u/Haunting_Group_5483 on 2024-12-04 22:46:10.

Hello everyone,

First of all, thank you for reading my post and perhaps guiding me to the proper way of solving my first personal data hoarding attempt.

After using Google Drive and some other cloud providers, I have decided to go a different route. Most cloud providers are limiting in bandwidth speed, total data transfer limiting or hard to 'mirror' and 'sync' properly for my use case.

Here's my idea:

Setup a 24/7 personal mini-server using my pc hardware to constantly look for changes and sync bidirectional to a single SSD as a mirror backup.

Be able to access the filesystem and the backup ssd (2 Nvme drives) remotely via SSH or equivelant, so I can access my files and download them or upload to the ssd's remotely using a laptop or another device.

Utilize the machine as a personal data storage for things like archived mail, attachements and pictures/media.

I am willing to start out slow and simple, using these specs and capacity. Note: I don't have a lot of big files, just a lot of small files.

Please let me know if I'm doing something stupid or if I am overcomplicating stuff.

Disk 1 - C:/ is an nvme. 990 samsung pro ssd that has 2TB of storage and is using a windows 11 os with +- 1.8TB of space. This will be the main SSD and the active operating system.

Disk 2 - is the backup SSD using a 980 samsung 1TB ssd that currently mirrors a google drive filesystem, but will shortly be formated and empty to be used as the potential mirror drive. This will mirror the filesystem of Disk 1 excluding the system files. I don't mind losing or corrupting the OS. I just want to have my data hoarding documents, media and mail etc. synced and backed up.

Disk 3 and 4 are 1TB Samsung SATA SSD's. Potentially for expansion and/or extra storage/extra backup for most important files. To be sure if both nvme drives somehow die, we still have these for emergency recovery and backup.

I am considering using either Linux or Windows to setup the mirroring daemon or equivelant.

1. What is the best software or method to do this? I am reading into rClone, rSync and some other software. I am willing to put in the effort to aquire the knowledge needed to set it up properly.
2. Is this practical and/or often utilized or am I doing something stupid/unneccesary?
3. What cloud storage as alternative to my mini-server is 'worth' it if we are talking about 5-10TB of data storage with frequenct small changes in files? Google Drive seems okayish but I still had some issues using 'mirroring'.

Thanks in advance,

Eduard

The original post: /r/datahoarder by /u/UzayzamanYolcusu_ on 2024-12-04 22:39:24.

I’ve been working on an open-source tool called rec-all, for anyone who likes to keep track of what happens on their screen. It’s a lightweight app that runs entirely offline, saving screenshots and extracting text using OCR and image captioning and let's you search through moments; everything stays local.

If you like the concept of having a personal "time machine" for your screen, I’d love to hear your thoughts.

https://github.com/bruuno-studio/rec-all

The original post: /r/datahoarder by /u/HKDrewDrake on 2024-12-04 21:28:31.

Original Title: Saw an auction where you couldn’t really tell what was included and the description read as “networking and server equipment”. Not shown: a randomly included plasma tv, boxes of cables, some cable management and a few faceplates. I’m in too deep.

The original post: /r/datahoarder by /u/suckseggs on 2024-12-04 21:19:14.

Flac albums? high res photos? Whole websites?

The original post: /r/datahoarder by /u/meyerovb on 2024-12-04 21:02:27.

I modified the iframe playing it to controls=1 so at least my kid can fast forward, but wondering if I can direct link to it or something.

The original post: /r/datahoarder by /u/1337haXXor on 2024-12-04 20:20:02.

The original post: /r/datahoarder by /u/spocksrage on 2024-12-04 19:01:01.

Original Title: Which internal drive would you go with? It says the max for each tray that it could handle is up to 10 tb. Im would want to tryto piece it togetherover the winter. I want to stay under 200 on a drive but try to be on the max side for the storage.

The original post: /r/datahoarder by /u/flowrider1969 on 2024-12-04 18:31:26.

A small (by this subs standards) 8tb Dell Enterprise drive for $50 Canadian but it has 57000 hours on it and 1500 power on counts. Crystal disk says it's good.

Looking to replace 1 drive in my NAS. Would you or wouldn't you?

The original post: /r/datahoarder by /u/Rambr1516 on 2024-12-04 18:06:59.

Hello all, this is an old old usb drive that I forgot I had laying around, it doesn't have any data that I dont need on it thankfully, but I am having trouble getting it to mount. It is going through a usb hub that I know works if it makes a difference. I have attached 2 photos and I am wondering if I am cooked, or there is something that I am missing! Thanks a bunch :)

https://preview.redd.it/8h2nui9jgv4e1.png?width=950&format=png&auto=webp&s=dd6b731f6f9ba39e6eb8d47f9343b6b911500db2

https://preview.redd.it/d71ab85lgv4e1.png?width=2130&format=png&auto=webp&s=89815f84a623d16226ce4aad33f6e0cec0c338ed

The original post: /r/datahoarder by /u/Electrical_Hyena_325 on 2024-12-04 17:24:00.

Are there any good Linux or Windows backup apps for backing up and doing incremental backups on DVD-R/BD-Rs? Seems most backup apps focus on backing up to cloud these days and the feature-rich ones can backup to tape. Ideally, the app can take a file system with TBs or PBs and split them to burn on archival quality 25GB BD-Rs.

The original post: /r/datahoarder by /u/obnoxious_banana on 2024-12-04 16:55:15.

Hi DataHoarders -

I'm new to all this, looking for a solution to lessen my need on Cloud systems (iCloud / Google Photos / Google Drive) and also create some local backups of things also stored there.

My primary problem i'd like to solve is to create a local backup of a large iCloud Photos library.

This backup would be independent from iCloud and keep up to date automatically - based on searching this subreddit people like either: icloud_photos_downloader or using the iCloud windows software for this.

Once backed up i'd like to be able to find a nice way to view these photos using something like Immich or other local photos software.

Where I need some help is on the hardware side of things. I'm not totally sure what I need.

I assume I'll need some kind of networks attached Windows Machine that is always on, and able to execute the icloud_photos_downloader and host the software.

Should I also purchase some type of NAS, or could I simply add a bunch of storage to that machine?

If I went with a NAS, is there a recommended unit that reasonably easy to setup / use?

Thanks!

The original post: /r/datahoarder by /u/oslavq on 2024-12-04 15:32:15.

Sometimes I want to save a reddit post with it's replies as a JSON, TXT or any other storage efficient format, are there any tools to do it? Most of the tools I found scrape subreddits or users, not individual text posts.

The original post: /r/datahoarder by /u/BrickAndroid on 2024-12-04 02:28:58.

I have a bunch of hard drives that I want to systematically/programatically fix from this issue preemptively, since they contain tons of files. I'm sure some of you have ran into this issue before.

Basically, there are certain files (the only ones I've encountered this with were video files that I torrent) that Windows Explorer tries to generate thumbnails for when you open their folders, but they can't, and this causes a bunch of issues. You can't delete the file because it's stuck, so you need to use IOBit Unlocker to force IO unlock the file so it's no longer being used by the process that generates thumbnails (I believe that's "COM Surrogate"), then you can delete it. But that's not just it. Once you go to another folder, Windows Explorer will get stuck saying "Working on it" and you can't view anything in any folder, so you need to restart it from task manager.

I'm asking this here and not r/techsupport because that sub is never helpful and it's generally better to ask on specific subs.

I've had this problem before with a file months ago, but I forgot what the solution was. I tried retracing my steps from my browser history, and I found solutions saying I should open command prompt as admin, then run "sfc/scannow" and "chkdsk e: /r /f" (e of course being the E: drive), though that didn't help.

Has anyone here dealt with this problem and knows the solution? My only way of dealing with this currently is just deleting the problem file then trying to find another source to download it from. Some files are too difficult to find replacements for, so I'd rather fix the files somehow, and do this for all my hard drives.

The original post: /r/datahoarder by /u/Any_Stick3591 on 2024-12-04 02:09:01.

Looking for some advice here as I’m relatively new to data storage being outside of an external drive and cloud backups. I am fairly comfortable on a computer so I can learn new stuff but not sure a good route.

Multiple devices - would like a home based cloud storage solution to allow backups from at least four separate devices.

Storage - expandable, but looking at probably 10 TB or so, although I may have a lower “critical” data that’s closer to 2-3 TB. So maybe 2 drives mirrored for critical data and just a larger home for random data.

I have a mix of MacOS and Windows devices.

Could maybe setup a small server if that makes sense with an old computer if that’s a good entry point. Ideally - would like to have a good expandable system so a lower cost entry point and the. An upgrade path would be nice.

Where should I head with this?

The original post: /r/datahoarder by /u/TheOmen_666 on 2024-12-04 02:07:01.

I'm working on a project. If we gather a few people. In a few days, we'll be able to collect all data available from different resources. Please, msg me if you're interested in the idea.

The original post: /r/datahoarder by /u/Ok_Wolverine_4268 on 2024-12-04 13:48:34.

Hi, I'm looking for this youtube video. It is titled "Will Smith EXPOSED!"

This is the original URL: https://www.youtube.com/watch?v=2r2EgiwuEWY

This is one of the wayback machine captures. I'm trying to download it but it is saying that the video was not archived: https://web.archive.org/web/20221030133006/https://www.youtube.com/watch?v=2r2EgiwuEWY

The original post: /r/datahoarder by /u/iamarealslug_yes_yes on 2024-12-04 12:56:30.

With the looming tariffs and beginning trade war for minerals/parts, will things only begin to get more expensive? Was looking at picking up a small setup just like a 2 bay NAS with 20-36TB for Plex, some self hosted stuff, and a ton of Photos.

The original post: /r/datahoarder by /u/animalcookie07 on 2024-12-04 11:38:12.