The original post: /r/datahoarder by /u/Final_Wedding_5634 on 2024-06-05 16:13:40.

Hobbyist Photographer and videographer looking for DAS to expand my 2019 Macbook Pro's working space and archival backup space.

Cost is certainly a consideration.

I have two needs:

1. Backups - I presently have 2 x 3TB 5.4k rpm HDDs for storage in a desktop nearby. This PC needs to be replaced as its old and dying slowly. The HDDs work great - used for cold storage. the PC is off most of the time.
2. More working space. Presently, I just keep my MBP clear of working document - i only load one project at a time and work off the internal 500GB SSD. This works but is getting tedious. I typically edit in either iMovie or Davinci Resolve (depending on project needs) and would like to move this to a larger DAS.

I'm thinking I'd like

• 1 DAS with 4 bays. But from who? OWC? MediaSonic?
• Configure the two HDDs into a single Raid 1 for local backups with redundancy. I'll copy files to cold storage as needed. This data is backed up to an external drive in a fire-safe and critical docs are backedup to the cloud as well.
• Configure two SSDs into a single Raid 1 for faster working space redundancy. I'll use these as working space for editing two or three streams of 1080.60 video. Once projects are finished, the final result and maybe the raw footage is saved to the HDDs for archival.

Questions:

1. General thoughts for this approach? I'm sure i'm not the only one doing this but I couldn't find anything. Maybe I should just go RAID 10 or 5 or something :(
2. Is there a specific bus type to handle 2x 1 Raid? How do i know if a DAS can handle this 2x Raid 1 configuration? is any JBOD good enough? Suggestions for affordable DAS?
3. Raid controllers? Do i use Disk Utility or the DAS's softwareraid? Who's got the best notification of a failed drive?
4. Speed - ideally i'd like NVMe as it's fast and future proof (i.e. I'll eventually get into 4k filming, maybe). Are there boxes that have NVMe and HDD? I couldn't find any. Would SSDs suffice (the 2.5" variety such as evos).

edited for clarity

The original post: /r/datahoarder by /u/Early-Mechanic6508 on 2024-06-05 14:04:02.

My job has about 900 TB worth of storage.

I'm looking for a cloud-based backup.

Google Drive seems to have increments of 5 TB. Should I just get 200 users on drive?

Since Dropbox unlimited is dead, that does not seem to be an option.

Does anyone know a cheaper way? Does anyone have any suggestions?

The original post: /r/datahoarder by /u/NETWORK_LINK on 2024-06-05 13:18:25.

I am looking for some guidance around creating kinda server. I have been flirting with the idea of a NAS or something like it but dont know where to start or if its what I even need.

Currently I have a few drives that i am manually copping the data over in order to back it up. This method sucks and want it so that if i change something on one drive it does it for the rest. Im also looking to run some of my archiving tools off of the system such as 4k downloader which i use to download and save some youtube stuff automatically, the goal of this means that it will automatically update all the backup drives with all the content. Also I am looking to run either a plex or jelly fin off of the device.

In sort what do i need to make this happen and can it be done on the cheap? and if i were to set it up as descried could i just plug my laptop in and use the network as basically a giant memory stick?

The original post: /r/datahoarder by /u/dopeinder on 2024-06-05 04:42:12.

Hello newbie here. I am planning on buying a WD Blue 8Tb and an enclosure with a fan (this one https://a.co/d/fmZVRcu). Intuitively, I'd think that having a fan connected directly to the enclosure body would transmit the vibrations to the HDD. Is that the case? Thanks!

The original post: /r/datahoarder by /u/Gazumbo on 2024-06-05 15:44:13.

I've been using Arq for a few years. No majors issues, although I haven't had to test a full restore. I've been tempted to switch to Macrium as I already have a disk image using Macrium and switching would then mean I'm only using one piece of software instead of two.

But, with regards to file and folder backup, what would I miss by switching to Macrium? I'm a home user and not knowledgeable on the more technical side of backup software. I believe Arq does a full backup and incremental from then on. I know Macrium has this option also.

My main need is software that will never delete a file from a backup, no matter if I delete the source file or move it. Retaining a few versions. Bonus would be the ability to mirror this backup to the cloud in some form.

Currently, I have local backup to an external drive using Arq, and cloud backup to backblaze using their personal computer license. So it's two different pieces of software but that's not a problem.

The original post: /r/datahoarder by /u/That_Guy1818 on 2024-06-05 15:09:15.

The original post: /r/datahoarder by /u/doubledundercoder on 2024-06-05 15:01:01.

Hey all. I’ve got a usb 3.1 jbod attached to a decent laptop with 16gb of ram with a roughly 16tb zfs RAID. Works fine most of the time. I get 100mb/s reads if only one process is accessing the volume. If more than one process try’s it just tanks.

Upgrading to a SAS enclosure or just getting a desktop case where I plug in the drives directly to the sata controller, what kind of performance increase can I expect for multiple processes on the volume? Am I dreaming thinking it will make a huge difference? It’s mostly for hosting Plex. Anyone gone from this setup to a direct attached on zfs?

4 7.2k sata drives

The original post: /r/datahoarder by /u/SproutingLaughter on 2024-06-05 14:56:33.

So I have around 100 gigs of music on my other hard drive which I have accumulated over the months (that amount may not seem like a lot to some of you guys haha) Until now I've been just downloading it all again when I get a new pc or something. Not looking forward to downloading it all again though so my question is, what's a relatively cheap and easy method of storing music? Most of them are in mp3 and some of them are in flac.

Thanks.

The original post: /r/datahoarder by /u/Kevalemig on 2024-06-05 06:26:21.

Original Title: Currently have a desktop PC with a 1-bay NAS hosting my video and audio. If I get this 12u rack with UPS and power strip with 2 vented racks, 1 to sit my PC on, other for my modem and wifi. My next purchase will be a rackmount Synology 4-bay nas. is this the way to go for me?

The original post: /r/datahoarder by /u/raisedbyowls on 2024-06-05 06:11:24.

I know it’s an account only thing, but it’s easy to reg and there’s so much stuff, but I discovered that nothing can help me to get the video lasting over an hour. It’s a legal video, just in case.

The original post: /r/datahoarder by /u/Candid-Hunter7812 on 2024-06-05 00:16:57.

As title, I am currently using windows storage spaces, I am about to add a 3rd 18tb drive. My current situation, is my write speed with my two drives under my storage pool, is not getting the bandwidth it should have, i am getting read/write speeds of a single drive, not both.

It could be that I formatted one of the drives in the pool incorrectly, if that is a possible, and would limit my read/write speeds, could someone help me find out?

I really don't want to rebuild, I have about 20tb of data, it would be nice to retain 10tb of it, so maybe i could install the 3rd drive, move over 10tb worth of data from my pool, delete the pool, format the drives correctly, add the two drives back, copy the 10tb of data over. Then add the new drive to the pool?

The original post: /r/datahoarder by /u/volthunter on 2024-06-04 23:23:03.

This is inspired by a conversation I've had which often feels cyclical about how we are losing access to most of the data on the internet, Yuzu the switch emulator was taken down and with it many clones and spin off's, Vimm's lair has had it's Nintendo roms forcefully removed, internet archive is being sued and getting cease and desists, some from Nintendo some from other companies, we've lost a multitude of pirate websites as of late, but people think piracy " cant be defeated".

My point being that in the past 2 years more damage has been done to the current scene of the internet and preservation than all the years prior, it's not just about piracy or emulation, it's more than that, google search was a vital core of the internet and it's been ripped out.

It's like the adage that there is a man in Czechoslovakia maintaining a piece of software that is crucial to the internet's existence and multiple times that has proven to be true, and now google has fallen and the internet is worse for it.

A big loss that most people don't know if is that visa through their various connections to right wing christian organisations was actively campaigned by mormon extremists to revoke funding from most of the main xxx websites such as pornhub and xhamster, this seems funny, but an incredible amount of material was lost and i don't think it wise to dismiss something like this as just some minor occurrence.

This may have been one of the largest data losses ever, the loss of amateur content on pornhub represented billions of hours of video that is lost to time, and PornHub conclusively proved that it was a sham case set up by a mormon church that aims to ban all adult material and even then, they were forced to shut down a retaliatory case and to shut down the amateur section of the site because of pressure from visa.

The government itself has made material that many corporations would prefer you don't have access to such as fixing old factory equipment and booklets on home electric repair, with the american governments currently starting the fight to launch right to repair, you must realise that the companies would prefer if you did not have that right or information, ifixit and it's guides would be eliminated.

Even the people testing products, tech channels like linus and level 1 techs would all be eliminated in time, too much finds itself at odds with these companies and you think it's hypothetical but if you upload a video tearing down an iphone and repairing it, apple may take it down, they are known to do it, same for john deer tractor hacks and lg washing machine repair videos, this is a fight, and we are losing.

Anyways, i just see things getting worse and frankly it seems like we aren't bouncing back how the internet seems to think we are, the torrent scenes are no where near as alive as they used to be, even with private trackers, the scene is a shadow of what it once was, and i only see it getting worse, so hoard, data hoard it all.

The original post: /r/datahoarder by /u/thrasher2017 on 2024-06-04 21:45:14.

Looking to digitize at least 20 totes of photos ranging from my childhood (24F) all the way to my grandparent's childhood. Ranging in size from 4x6 to 11x14 and are a mix of b&w/color. I'm looking for a scanner to get the best quality and looking to spend $300 or less. Would be great if it could scan slides as well because I have a bunch of those but am willing to get something seperately if needed. Also for you NAS people, I'm looking to start one of my own to backup this monstrosity of photos on, what is an easy NAS setup you recommend? TIA!!

The original post: /r/datahoarder by /u/tsomaranai on 2024-06-04 22:24:34.

I currently have two 2tb hdd wd that are half duplicate of the important stuff and half random. I was about to get a 4tb hdd and someone recommended getting an ssd instead since it is faster and shouldnt fail mechanically. What I care about the most is reliability and lifespan without maintenance, does either of those require some software to run through the data to not go stale? I mostly just want to back up my media there without headache...

The original post: /r/datahoarder by /u/That_Fetcher-Fargoth on 2024-06-04 22:03:14.

Just got a new HD for my all-in-one gaming/media server PC. Would it be okay to move/copy (I was leaning towards "copy" and saving the old HD as a backup) the 4tb HD's contents over to the new HD? Or is there another way I should be doing it?

Edit: After doing a bit of googling, I've seen people mention Robocopy, Unstoppable Copier, FastCopy, and Tera Copy. Are any of those relevant to what I need, and is one better than another? I tried running Robocopy (it's apparently installed by default), but nothing seems to happen when I do.

The original post: /r/datahoarder by /u/FinleyGomez on 2024-06-04 21:22:54.

The original post: /r/datahoarder by /u/OliveBranchMLP on 2024-06-04 21:04:54.

Howdy, I'm a film editor looking for an "active" solution to my problem.

I have tried Googling this with terms like "cold storage" and "file retrieval" but those are giving me results that aren't applicable to my use-case scenario. I'm sure this setup exists, I just have no idea what it's called or what words to search for it.

My current setup:

I have two drives:

• an "active" 2TB NVMe SSD, where I put all the stuff I'm actively working on
• an "offline" 24TB SATA HDD, where I put all the stuff I'm not actively working on

The folder structure is identical between the drives, but to optimize space, no actual data is duplicated between them.

(Yes, I have both drives backed up to a third drive.)

The problem:

It's getting cumbersome having to manually move files to and from these drives as I need them, especially while preserving the file structure. I always have to dig into every folder to move the individual files because I don't need EVERYTHING in that folder. And it's hard to keep them in sync or avoid file conflicts because every syncing program I've found tries to sync EVERYTHING.

What I want:

Is there a way to automate this process, so that I only ever look at my SSD, but my SSD shows me everything that's on the HDD too as if they're one drive, and when I open a file on the SSD, it transfers it over from my HDD?

Any help would be appreciated!

The original post: /r/datahoarder by /u/TheGenkz on 2024-06-04 20:43:56.

Does anyone have any recommendations on a box or bin that could efficiently store external hard drives?

I have about a dozen of them in varying sizes that I need to remove from a shelf to make space, and have long since discarded their original boxes. I would ideally like to be able to move the box as needed without worrying about the drives sliding around/getting damaged.

The original post: /r/datahoarder by /u/irinaz165 on 2024-06-04 20:19:28.

Hi! I've been trying to upload some videos to okru, I have the .srt files for the subtitles but I can't find the option to add them to my videos.

I know it's possible to do it because I've seen videos with the option of turning the subtitles on and even with several languages to choose from.

Thanks in advance!

The original post: /r/datahoarder by /u/SP4CEBAR-YT on 2024-06-04 20:04:02.

I have many storage devices with photos, documents, and backups of other storage devices, so there are a lot of duplicate files and photos. To fix this, I probably need a NAS with a good mobile app that can:

1. find duplicate files and photos
2. delete local photos after transferring them to the NAS
3. handle errors during Photo transfers (and avoid partial transfers that can't be resumed)
4. optionally find if a photo is a photograph or a screenshot based on its metadata

What NAS Manufacturers do you recommend based on their mobile apps and NAS software?

The original post: /r/datahoarder by /u/Uhuhgurl on 2024-06-04 18:22:30.

Hello all, I’m seeking advice from the experts here on finding the right storage solution for my wife and I. 

To give you some background, my wife is a professional photographer primarily working in digital. For many years, she has been using an external drive for her work. I, on the other hand, shoot film but recently started digitizing my photos.

We had a Synology SD215 for a few years, which met many of our needs but was ultimately too slow for my wife's requirements. Additionally, we didn't fully utilize its capabilities. Now though, we believe integrating a NAS back into our workflow is exactly what we’re looking for.

Some requirements:

• A storage solution that allows multiple users to interact with it simultaneously.
• Large storage capacity with fast read and write speeds.
• RAID capability for data loss protection.
• Versatility for various uses, including working storage, archival storage for digital assets (primarily images), potential Plex use, and security camera support.
• A "set it and forget it" solution that won't require frequent upgrades or replacements.

Until this morning I was considering the OWC Jupiter Mini but I have some concerns about its network requirements (though I’m not opposed to upgrading our network if necessary). I’ve also considered a DIY approach but would prefer a solution with customer support in case we encounter any issues.

Any recommendations you have would be greatly appreciated. Thank you! 

The original post: /r/datahoarder by /u/Mutiu2 on 2024-06-04 18:10:12.

Looking to replace a WD My Book Thunderbolt Duo, which contains a couple of 3.5" drives.

What are some some good options for a similar Thunderbolt drive (or USB 3) with a couple of 2.5" drives instead, which presumably would run cooler and more quiet?

The original post: /r/datahoarder by /u/asheritess on 2024-06-04 18:04:28.

TLDR: Is there any program that will analyze my images for text and attach what it finds to its metadata or create an external index, such that I can search by text in finder/file explorer?

I'm currently using Apple's Photos to store nearly all my photos, in conjunction with periodically exporting my images from iCloud to hard drives.

I have a good degree of organization of my exported files, able to export them with dates attached. This is useful for finding photos from trips I know the dates of or walking down memory lane. I also backed up the actual Photo Libraries that the app loads back when they were manageable sizes that could be stored on my computer.

When I did work for distance learning, downloaded images, etc, the amount of images I generated skyrocketed. Since then iCloud's image recognition and character recognition abilities have become exceptional in my opinion, even processing frames of videos. However, this is not available on the desktop app.

My efficiency has increased, as on my phone I can search my indexed library going back years by date, location, subject, and text. As of late I have been delighted to see that I can also search by text for images in folders on my Mac. I want to reap these benefits on an external storage drive.

I've seen multiple image library applications with OCR capabilities. I understand that they are not able to handle such a large volume of images. I do like the convenience of scrolling through a library and am interested in hearing suggestions for these, although I have done some research myself. An issue that it poses is (in my experience) libraries doubling the amount of space my images take up by making their own copies for the library, and if I attempted to put all my photos into libraries that would take up so much space.

I wonder if an idea I have has been executed by anyone other than Apple: is there any program that will alter the metadata, or create an index independent of a library app, such that I could search by text within Finder(/file explorer)? I want to use this feature on my backup drives and have all my images processed like what my laptop is currently doing locally. Or alternatively, is there a way to use Apple's feature on an external drive?

The original post: /r/datahoarder by /u/ShapeShifter499 on 2024-06-04 17:56:40.

Is there a decent 5 or more bay JBOD enclosure that supports UASP? My primary use is with a Linux machine via usb 3.0.

I tried a terramaster D5-300C but I'm getting a load of I/O errors that seem related to UASP capping out. I may return it unless there's a software fix.

Should I just resort to not having UASP on JBOD?

The original post: /r/datahoarder by /u/OkBackground5843 on 2024-06-04 17:23:13.

I'm shopping around on eBay for a document scanner. I'm hoping to get something good for under $150 which is why I'm shopping used. I see quite a few Canon DR-M160's within my price range. It seems like this is/was a fairly high end scanner, will it hold up well for home use?