It's A Digital Disease!

The original post: /r/datahoarder by /u/Consistent-Scene2781 on 2024-07-27 10:03:21.

Hi DataHoarders,

I'm in need of some assistance with my digital book collection. I'm using MyOCRPDF on Ubuntu 24 LTS to make my scanned PDF books searchable. While it works well for individual documents, I'm struggling with batch processing since I have a large number of books to handle.

Moreover, I find using the command line challenging and would prefer a GUI solution to streamline the process.

Has anyone here successfully batch processed PDFs with MyOCRPDF using a GUI on Ubuntu? If not, can you recommend alternative OCR tools that are efficient for batch processing and offer a user-friendly interface?

Any advice or recommendations would be greatly appreciated!

Thanks in advance!

The original post: /r/datahoarder by /u/iizakill on 2024-07-27 23:30:53.

Hi! I am looking for a 2/4 bay DAS for my Linux system. Narrowed down to these two options:

1. https://a.co/d/3rEPBRE
2. https://a.co/d/dIx4TWc

I already got the 4 bay one above, and currently running badblocks on 2 HDDs. I had to run a watch command to make sure the HDDs don't go to sleep, otherwise the test was getting abandoned.

The 4 bay one uses a JMS578 and the 2 bay one uses a ASM1352R. I have been seeing a few posts now that stay away from JMicron chips and they have a lot of issues.

My only requirement is to use this as a DAS on my Linux Server for Plex. Any suggestions if one will be better than other? I don't care about RAID. I want to be around the $50/2Bay budget.

The original post: /r/datahoarder by /u/Sensitive_Plenty2649 on 2024-07-27 21:38:36.

Is there a way to encrypt and access files on an SSD, without having to actually install e.g. VeraCrypt on every device I will try to read the files from? On Mac this just simply works with Disk Utility, but for every other OS? I'm constantly on the go and need still protection to my files. How do I do that? Is there something that does this? Or could I just install a portable version of VeraCrypt onto the SSD and use it to encrypt the encrypted container from that same SSD?

It's a 2TB SSD and it contains a lot of files for work (I'm self-employed) and "the cloud" is too slow for my workflow.

Thanks!

The original post: /r/datahoarder by /u/OnionTaster on 2024-07-27 21:37:02.

I'm running out of storage on my phone again due to thousands of photos and videos. I usually just transfer them to my hard drive and delete them from the phone but I really need instantaneous access to them.

I tried setting up own/next cloud but its basically impossible for newbie and even if I somehow managed to set it up I believe my current router doesn't allow port forwarding so not like it would work

Is there anything simple to set up on my windows machine that allows access to the photos over the internet ?

The original post: /r/datahoarder by /u/AlignedBowl4 on 2024-07-27 20:52:26.

The size of my video collection has exceeded the amount of storage that is on my tablet. I’m considering getting a 1 TB flash drive and storing videos on there for easy access for whenever I want to watch stuff on the tablet. It’s significantly cheaper than getting a new tablet with more internal storage. Is this a good idea and will a UBS-C flash drive be reliable enough for this?

The original post: /r/datahoarder by /u/mignone_roy20 on 2024-07-27 20:51:38.

Hi,

I've been searching a bit on answers, and get sometimes a bit confuse about the answers. I'd like to have an external hard drive accessible through local network, from which I could play any media (I don't need to convert it, just like a regular HDD, I'll just open it with VLC and watch it).

All seems to point to NAS, but with a lot of "overkill". People are saying that some (ds423+) can convert files on the fly to access it from your phone or other devices, and I don't really need that.

I'm looking what could be the best solution to just put medias on it (10To would suffice for now), and access it, over local area network if it need it's own power, or "plug and play" solution if it's powered by USB.

I don't need a solution with integrated backup plan, as I will move it elsewhere.

For more details :

I have 205 Gb of footage on game A

I have 726 Gb of footage on game B (With roughly 120Gb per raid, and 20Gb for PvP edits)

Is an external CD player worth it ?

It seems not because CD's seems to not be able to have more than 9Gb, from a really quick search I did Are USB (or external hard drive) good enough ? I could have a collection of USB/eHDD with post it on it like "game A", "Game B - Raids" and "Game B - PvP"

Or even more cut, like "Game B - Raid A", "Game B - Raid B"

What would you use it in my case, to have all your data easily accessible without being in your computer ?

The original post: /r/datahoarder by /u/shrimp_master303 on 2024-07-27 19:53:52.

I’m setting up a NAS right now (with openmediavault) for primarily media files, using mixed drives and likely mergerfs + snapraid. I will use it for streaming the files and also torrenting. So files are written once, read multiple times.

I initially thought BTRFS was the best choice because of all the modern features on it, but the more I research it seems like it would be a waste given my use case.

Namely, the file compression feature wouldn’t do much on video/media files as they’re already compressed / encoded. The ability to detect file corruption actually sounds like a disadvantage, since video files will still play with a small amount of corruption, but using corruption detection would instead throw an error and fixing it might not be possible. Snapshots don’t seem useful here either, I can just backup my drives with rsync, I don’t need multiple snapshots.

Is XFS the best choice for all my drives, data + parity? I’ve read it’s the most performant. The one thing I’ve read that worries me is how resilient it is to power loss.

The original post: /r/datahoarder by /u/steviefaux on 2024-07-27 19:37:54.

I have one of these NAS which is now old. Still works but is it worth trying to find drives large enough that will work. Of just look to get a replacement.

Since getting jellyfin, even my 5tb wd passport is almost full.

The original post: /r/datahoarder by /u/Blackstar1886 on 2024-07-27 18:44:21.

I am trying to come up with a sensible data management strategy and was hoping someone might be willing to weigh in.

PROBLEM

Have several external drives each on their own USB or network connection, separate power supplies etc...

There are 4 drives total:

• WD MyCloud 4TB - Unknown Filesystem (connected by network, but firewalled from the outside -- still not happy about the risk)
• WD MyBook 4TB - NTFS (connected via USB)
• WD Elements 12TB - NTFS (connected via USB)
• WD EasyStore 14TB - Mac OS Journaled (connected via USB)

I previously used the WD Elements 12TB as a "Master Backup" drive for the MyCloud and MyBook using SyncToy on Windows. The EasyStore is not well backed up right now.

I no longer have the Windows machine and want to make my Mac my primary driver. I had planned to simply reformat all the drives to Apple's filesystem and find a SyncToy equivalent, but Mac's have a known issue about sleeping external drives resulting in possible data loss from my understanding.

Note: I have never schucked a drive before and worry about the potential for damaging drives I can't afford to replace.

SOLUTIONS CONSIDERING

All the options involve moving things around to reformat the drives I'm assuming since the NTFS support on Mac and Linux isn't 100%.

• Keeping my Mac awake all the time so I don't have to worry about the drives getting ejected on sleep.
• Using a dormant Raspberry Pi 4 I have lying around as a NAS and connecting the existing drives to USB 3.0 hub.
• Trying to find a 4-bay NAS in my $200 budget and risking schucking the drives.
• Buying an old tower that can accommodate 4 hard drives via SATA, installing Linux, and risking schucking the drives.

The original post: /r/datahoarder by /u/CanberraPhoto on 2024-07-27 18:22:58.

The original post: /r/datahoarder by /u/vagrantprodigy07 on 2024-07-27 18:12:57.

I've had a few drive failures recently, which has exposed the frustratingly bad drive design of my current case. I'd like to rebuild in the next year with a new case, and would ideally like a case where I can just slide the drives in without opening the rest of the case.

I've seen a few options on Amazon, and pcpartpicker lists a few as well, but what cases like this have you used, and which would you recommend?

The original post: /r/datahoarder by /u/Maratocarde on 2024-07-27 17:45:15.

The original post: /r/datahoarder by /u/clydeshelton01 on 2024-07-27 17:38:52.

I have ventured down the rabbit hole and am afraid that i am so lost im in a state of perpetual inaction for not wanting to underbuild or buy something that doesnt handle what i want.

I was going to go the synology route, but the lack of transcoding of the new models or lack of 10gbe support on the models with transcoding pushed that thought back. Also i want to run truenas scale.

I have looked over the Nas Killer, but everything is shipping from china(not inherently an issue, but ive never had good experiences) and its also information overload because not everything is clear cut or in stock.

So im turning to a pro, fully admitting that this is a super noob post and im sure happens alot, but i actually am gonna take action on the feedback.

Here is my wishlist/use cases (totally open to having 2 different setups if that makes more sense)

• Running on Linux
• ECC not necessary
• Storage (obviously lol)
• Plex server capable of 4k playback
• Capable of hosting multiple VMs
• upto 10GbE internet
• as up to date as possible, without being unnecessarily latest gen

I want it to be fast over everything.

Edit to add price: would like to keep as close to $1,000 as possible before the storage

I do have a server rack, but not necessary for it to be rack mounted, i think i might prefer it to not be.

I just want a build list, you tell me what parts to get and i will assuming the consensus is there.

bonus points if i can go to microcenter and buy it all today lol

The original post: /r/datahoarder by /u/charlesGodman on 2024-07-27 13:56:50.

Problem: I need to archive some data. Ca 10TB. I am planning to keep the data for 40 years. I don’t need to access them. They just need to exists. Therefore I was gonna buy a single HDD copy all the data over, unplug it and put it in my drawer.

Questions:

• Is that a good strategy?
• What drives are reliable for this (eg WD purple vs black vs blue etc etc)? Price is relevant but I pay what is necessary.

Context: The data is important to me but my life doesn’t depend on them literally :) I am planning to keep a copy live in my NAS or in a second drive.

The original post: /r/datahoarder by /u/tutanmac on 2024-07-27 12:54:31.

The Xbox 360 store is shutting down for good on July 29th. Is anyone here aware of or involved in archiving the themes from the store? I'm not sure if this is the right place but I posted on r/xbox and someone suggested I link it here incase someone wanted to preserve them.

https://www.reddit.com/r/xbox/comments/1eb78lk/beautiful_xbox_360_themes/

The original post: /r/datahoarder by /u/quietgui on 2024-07-27 11:33:43.

Dell list these drives at 600€+ is there anything special about them or can I use them like any other drive? I‘m looking at used ones for a fair price of 150€. They add additional information about sectors 512e/4kn (??), is that important?

The original post: /r/datahoarder by /u/pm_me_your_good_weed on 2024-07-27 11:14:09.

I noticed my usb port is bent and I'm pretty sure it's from the cord pushing on it. It's only 1ft long and very stiff, I've started to use the drive upsidedown to reduce the stress on the port. I did manage to bend it back a bit so the cord will stay in place, but I want to replace the cord so it won't damage it more. Is there a overall trusted brand or should I just go to Staples and start feeling up cables?

The original post: /r/datahoarder by /u/Torley_ on 2024-07-27 08:59:37.

The original post: /r/datahoarder by /u/Throw_away-5979 on 2024-07-26 21:36:39.

I’m a private investigator and I’m trying to go through and write down all of the nature codes for an inquiry report. Downside is I have over 900 pages with 50 entries on each page. Is there a program or software I can use that take every single one, and remove the duplicates?

The original post: /r/datahoarder by /u/0x5f3759df-i on 2024-07-26 19:26:50.

Testing SD Flash longevity: I found a couple old SD Cards from about 2012 that I hadn't touched, figuring this would at least tell me something about 'bit rot' potential. I don't know what type of cards these are MLC, TLC etc, they're just generic sandisk from 2012ish, used in a Nikon. I copied about 10gb of .jpegs (fat32) from 2 16gb cards onto a mac. And... it worked fine!? no file error messages at all... I opened all the images in 'preview', no CRC errors, no 'this jpg image is corrupt'... they all open and look perfectly fine as far as I can tell. And I think JPG standard has some sort of hash or crc or something to detect issues. So? wtf? I hear all about flash bitrot, but in my one, unscientific, test, I was unable to verify _any_ bitrot whatsoever in 12 years from sd cards stored in a drawer?

I was reading about supposed inevitable 'bit rot' of SSD and flash data, but I surprised I could find NO ACTUAL RECENT TESTs to back up any of the claims or hand wringing online, with, you know. data. none. nada. zilch. So here's a data point of 1, anyone else have an actual data point on this? anyone have any more actual test data?

The original post: /r/datahoarder by /u/ignoremesenpie on 2024-07-27 05:52:07.

I have a ton of Japanese media for the sake of language-learning outside of Japan. It started out with frustrations over "free" anime streaming sites not letting me turn the subtitles off, and then paid sites not having the less-than-mainstream shows I want to watch at all. At some point I found out that torrenters also don't like having burning in subtitles that weren't part of the animation in the first place, and that torrents for more obscure stuff was easier to find.

Then I branched out to live-action films and TV dramas from private trackers that expect me to seed back, and I thought, "Screw it, I have the storage space. Let's build up some BP!"

It hasn't gotten so bad that I'm running out of space. Honestly I could fit more. Plus I'm compressing whatever I want to keep since my eyesight wouldn't be able to tell the difference unless I nitpick, and that would take away precious language learning time. However, this has had the effect of making it seem impossible to get through the backlog I've built up for myself.

Yeah, I could just get off Reddit and watch, but I'm considering a gameplan and would appreciate your input so that I get through a good chunk of it without uprooting other aspects of my life and also not burning myself out.

The original post: /r/datahoarder by /u/theClutchComrade on 2024-07-27 04:01:28.

Hi everyone. I'm still thinking through my long-term backup plan for my larger repository of data but first I want to back up the most important things. The documents that cannot be lost in a fire.

• Family documents like birth certificates, marriage certificates and other official documents.
• Financial documents: mortgages, loan, contracts, title deeds
• Keys: Password manager backup, encryption keys, 2FA recovery codes
• Config files for various applications

I don't anticipate all this taking more than a few gigs and I want to make sure all this stuff is secure while I figure out how to back up priority 2 things like media. I anticipate treating this as cold storage.

My questions are:

• What physical mediums should I use. I thought SD or Flash Drive would do the trick but you all recommend against that.
• What cloud options would one consider.

TIA

The original post: /r/datahoarder by /u/Background-Car-6962 on 2024-07-27 04:00:53.

Listen I don’t really know shit about computers, but I have things that are really important to me that I want to save like photos, music, etc. that’s really important to me that I would like to maybe even show my future kids one day. I know pretty much all drives fail, but what’s the closest I can get to lasting a REALLY long time or what are actions I can take to ensure that?

The original post: /r/datahoarder by /u/madcatzplayer5 on 2024-07-27 02:23:31.

I personally like 720p, around 350MB/hr quality. I think it’s high enough quality where the video still will look watchable on a 65+ inch 4K TV but is still low enough where the storage required is negligible to save thousands of hours of content. For content I actually will watch, 1080p is my minimum, and for content I really like and it is available in 4K, then I go for 4K. I find 144p, 240p, 360p, and 480p to be not enough resolution for a large display and try to avoid those qualities if I can. 720p just feels like that sweet spot for just hoarding video that you probably won’t ever watch.

The original post: /r/datahoarder by /u/LizardKing_1967 on 2024-07-27 02:09:48.