It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
7051
 
 
The original post: /r/datahoarder by /u/Gary5Host9 on 2024-08-27 13:01:54.

I am in desperate need of new hdds for my archive storage, but I cannot stomach the current prices. I also don't trust the refurbs much as I've had more than one bad experience.

Will new hard drive prices ever come back around, or are the current prices the new normal?

7052
 
 
The original post: /r/datahoarder by /u/Lvcrmnr on 2024-08-27 12:36:37.

Hi,

I want to add a third backup physical copy to my data collection, and I will have to buy an HDD and copy the whole 3 TB of it.

I've always been simple and newbie to this, and would just select a couple of directories (not the whole 3 TB thing) and copy-paste using Windows File Explorer and then check if the size and number of files is the same.

Is it bad? I heard it might be less reliable to act like this. Do you suggest a file manager software? BE AWARE these files are not subject to be updated, so I don't have to overwrite them...I just dump my phone storage of trips, photos, videos, etc on my drives and then delete phone storage. Been doing this since 2010 and I really care for almost 15 years of my memories.

Maybe I should start doing checksum also? But wouldn't it be done manualy file by file?

Thanks in advance!

7053
 
 
The original post: /r/datahoarder by /u/GooglePlsStop on 2024-08-27 12:07:05.

I'll try to be brief with this, but I've recently came into a ~8TB (expected) data storage need. I have two young children, and I would like to store some data for their use in the future.

I'm quite busy at this point in my life, as I am helping tend to two young ones, repairing/remodeling my home, ontop of work and errands.

I've been trying to research data storage for about two weeks, and I feel a bit overwhelmed. To this point in my life, I've only ever bought 1-2TB HDD's from Walmart and used them.

I can afford to spend upwards of five hundred dollars, comfortably, on storing this data; but I want to use this money wisely, as it could be used for more "pressing" matters.

I currently have 5.5TB of data stored on 4 drives, plus 1TB on my PC. I intend to consolidate it altogether, in one place -- as I have maxed out everything I have (to include my PC.)

So far I've learned:

● HDD is best for long term storage/infrequent usage

● Any drive can die at anytime for any reason, so give up on my hopes of preserving this data for 10+ years

● User experience varies when buying drives (i.e., some people's Seagate HDD is great, some people's dies in 6 months)

● Buying internal drives and mounting them in enclosures yourself might be more reliable(?)

What do I actually "need to know" going into this project? What HDD brand is recommended? External or internal+enclosure?

Is it really just a "shot in the dark" on whether your money is spent well?

It all seems very overwhelming, if I'm to be honest.

7054
 
 
The original post: /r/datahoarder by /u/Derpa_Durp on 2024-08-27 11:11:12.

Hi,

I use the arrs with hardlinks on a JBOD using Windows.

When my HDD's fill up I tend to get a buy a new one etc.

Problem is when updating a movie on the older drives it doesn't create a hardlink since hardlinks don't work over different drives. Normal behaviour.

Instead it copies them but after a while it uses up a lot of space.

So I tried looking for a fix to my problem and stumbled on using a drivepool.

First I tried Mergerfs since that apparently allows hardlinks. Problem is I'm not tech savy and couldn't get it to work ( operation denied, permissions errors etc).

Drivepool for Windows is easy to use but doesn't support hardlinks. Or not without some tweaks?

I saw a closed old post with a user who got it too work using Filebot and a Powershell Script. https://www.reddit.com/r/DataHoarder/comments/uwhyv0/my_setup_56_tb_drivepool_with_filebot_hardlinks/

Problem is I use Qbit and l'm not tech savy enough to adjust a script like this.

Other people say they've had luck with Symlinks? Has anyone had any luck doing this on a Windows OS and can point me to the right direction?

7055
 
 
The original post: /r/datahoarder by /u/Maximum-Warning-4186 on 2024-08-27 10:06:14.

Hi all

I have a truenas server approx 5000 miles away.

It will inevitably fail. No signs of this yet but everything fails right.

I have backups already on another server. Other than replacement disks, how do I plan for this to minimise downtime?

Would it be possible to move the truenas pool directly into a replacement server?

Tia

7056
 
 
The original post: /r/datahoarder by /u/kr80808 on 2024-08-27 09:47:13.

I have upgraded my server case to one that has a sas3 backplane with SFF-8643 ports. I have a sas2 hba card with SFF-8087 ports. I intended to order cables for this but could only really find cables labelled as SFF-8643 to SFF-8087, this initially had me thinking that they were the wrong way round for my intended purpose. Am I overthinking and it should be fine? Does the cable care which direction they are fitted?

7057
 
 
The original post: /r/datahoarder by /u/Blueitttttt on 2024-08-27 08:54:43.

Looking to get a WD_BLACK SN770 M.2 to plug into my laptop and offload files from, stuff I don't need on the laptop ssd but want easier access to over deep storage HDD's.

Is a higher end one enclosure worth the money or will a 20-30 pound Ali Express one work fine?

I don't need crazy speeds just to work and be fairly reliable

7058
 
 
The original post: /r/datahoarder by /u/Shomval on 2024-08-27 08:41:57.

crossposting to this sub since r/datarecovery only has 1.7k members vs the 770k in here

I got this enclosure recently: https://www.amazon.com.au/dp/B086YCWCRG

And have been using it just fine for the past few months. These are the drives I have:

  1. 4tb WD RED (contains all the data I care about)
  2. 16tb Seagate Seagate Exos X18 16TB
  3. 16tb Seagate Seagate Exos X18 16TB

I thought I'd make a Raid 1 drive with the other drives 2 & 3. I proceeded to do it and selected the drives correctly (I was aware you'll need to reformat drives when creating new raid partitions), however after the operation was complete, it seems like the software for the enclosure "ORICO HW RAID Manager" wiped all of them? Including the 1st one I didn't want to do anything to. The warning did not indicate that it'll impact all drives connected, even the ones you didn't intend to action.

I then couldn't view them in file explorer, and to be able to see them I had to open Disk Management, format the new 16tb volume as a new volume to see it again.

It seems like the same will need to be done for the 4tb drive to even run Recuva if anything is salvageable, but I am hesitating to run another format on the 4tb drive in the event it make it even 'worse' if that makes sense. I get the feeling I deleted what was called the partition table? Might be wrong.

I suspect I have lost all possibility of recovering the data, but if someone out there knew something more about data recovery and knew of a better course of action, do let me know?

  • To proceed with the reformat and hope Recuva still picks it up, or
  • Go somewhere else/use another method to recover the data

(let me know your fav data recovery tools, I stayed w Recuva cause I've used it for years and it's free)

update: I found TestDisk/PhotoRec but like Recuva, it doesn't detect the drive/lost partition

7059
 
 
The original post: /r/datahoarder by /u/adscombecorner on 2024-08-27 07:49:06.

MediaInfo suddenly not working with RAW images - MediaInfo works with all files except .OMF (it does not show up in right click context menu) - it was working fine a few days ago .. not sure what's changed - is there a setting to allow MediaInfo to recognise RAW images?

7060
 
 
The original post: /r/datahoarder by /u/Big-Performer2942 on 2024-08-27 07:08:50.

Context:

I initially listed a bunch of consumer cases with 8 drives because I was in the market for a case.

I've since added a bunch of suggestions from the community.

I've split up the tables by whether they're still in production. Haven't included white label goods such as seen on Chinese wholesaling sites.

This is not a guide or an endorsement , it's a list of consumer towers that can technically fit 8 drives or have been mentioned but discontinued.

Please look at the manufacturers spec sheet and consider other form factors that are appropriate to your needs.

eg,

8+ drives is not going to be quiet or cool in most circumstances.

For a little more cash you can go to a rack mount and buy a small cheap rack/trolley.

Capacity = Out of the box + manufacturer stated max once you buy extra cages. The actual max capacity may be much higher with some creativity.

| Brand | Model | 2.5" | 3.5" | 5.25" | 3.5" (unofficial) | Form Factor | Comments | Manufacturers site | |


|


|


|


|


|


|


|


|


| | Antek | P101 | 2 | 8 | 1 | | Mid Tower | | https://www.antec.com/product/case/p101-silent | | Dark Rock | Classico | 3 | 10 | 0 | | Mid Tower | | https://darkflashtech.com/collections/gaming-case/products/darkrock-classico-storage-master-case-atx-computer-case-mid-tower-with-4x120mm-fans-usb-3-0-ready-4-detachable-hard-drive-cages-360mm-supported-on-top-front-radiator-gpu-vertically-mounting-black | | Fractal Design | Define 7 XL | 2+3 | 8+10 | 2 | | Full Tower | Look at the Meshify 2 XL. | https://www.fractal-design.com/products/cases/define/define-7-xl | | Fractal Design | Define 7 | 2+2 | 6+8 | 1 | | Full Tower | | https://www.fractal-design.com/products/cases/define/define-7 | | Fractal Design | Define R6 | 2+2 | 6+5 | 0 | | Mid Tower | Sound damping | https://www.fractal-design.com/products/cases/define/define-r6 | | Fractal Design | Define R5 | 2 | 8 | 2 | 9 | Mid Tower | Sound damping | https://www.fractal-design.com/products/cases/define/define-r5 | | Fractal Design | Meshify 2 XL | 2+3 | 8+10 | 0 | 16 | Full Tower | Define 7 XL with better airflow | https://www.fractal-design.com/products/cases/meshify/meshify-2-xl-dark-tempered-glass/dark-tempered-glass/ | | Fractal Design | Node 804 | 2 | 10 | 0 | 12 | Cube | | https://www.fractal-design.com/products/cases/node/node-804/black/ | | Gamemax | Titan Silent | 2 | 8 | 3 | | Full Tower | | https://gamemaxpc.com/productkkk/1007-en.html | | Jonsbo | N3 | 1 | 8 | 0 | | Cube/NAS | Hot swappable | https://www.jonsbo.com/en/products/N3.html | | Jonsbo | N5 | 4 | 12 | 0 | | Cube/NAS | | Coming soon ( as of 2024-08-27) | | Phanteks | Evolv X | 6+3 | 4+6 | 0 | | Mid Tower | | https://www.phanteks.store/products/phanteks-evolv-x-black | | Phanteks | Enthoo Pro 2 | 11 | 12 | 0 | 21 | Full Tower | | https://phanteks.com/product/enthoo-pro-2-tg/ | | Phanteks | G500A | 9 | 2+8 | 0 | | Mid Tower | P500A is very similar | https://phanteks.com/product/eclipse-g500a-drgb-black/ | | SilverStone Technology | CS380 | 0 | 8 | 2 | | Mid tower | Hot swappable and locking | https://www.silverstonetek.com/en/product/info/server-nas/CS380/ | | SilverStone Technology | CS381 | 4 | 8 | 0 | | Cube/NAS | Hot swappable and locking | https://www.silverstonetek.com/en/product/info/server-nas/CS381/ | | SilverStone Technology | CS382 | 2 | 9 | 1 | | Small Tower | 8 Hot swappable and locking | https://www.silverstonetek.com/en/product/info/computer-chassis/cs382/ | | SilverStone Technology | DS380 | 4 | 8 | 0 | | Small Tower | Hot swappable and locking | https://www.silverstonetek.com/en/product/info/computer-chassis/DS380/ | | SilverStone Technology | TJ04-E | 6 | 9 | 4 | | Mid Tower | | https://www.silverstonetek.com/en/product/info/computer-chassis/TJ04-E/ | | Thermaltake | Core W200 | 0 | 5+9 | 2 | | Super tower | | https://www.thermaltake.com/core-x71.html |

Discontinued cases I've seen mentioned

Fine additions to any collection. If you can find them for sale I'm sure it would be a welcome surprise.

| Brand | Model | |


|


| | Antek | 900 | | Antek | 1200 | | Coolermaster | Centurion | | Coolermaster | N400 | | Coolermaster | Stacker | | Corsair | Obsidian Series 750D | | Corsair | Obsidian Series 900D | | Lian Li | PC-D600 | | Lian Li | PC-343B | | Nanoxia | Deep Silence 6 | | Rosewill | Thor v2 | | Thermaltake | Core V71 | | Thermaltake | Suppressor F51 | | NZXT | Source 210 | | Sharkoon | T9 Value |

Additional Storage accessories / addons:

You can get cages that mount in your roof, floor or covert 5.25" bays into 3.5" bays.

The 3.5" converters can be as simple as a metal cage and go all the way up to a self contained enclosure with a fan and hot swappable face plates.

Those enclosures are usually 3-4U sized and will slot into a case but unless you feel strongly about that hot swap functionality I think they're not great value.

Search for these terms:

HDD Hard Drive SAS SATA Disk Bay Caddy Cage Holder Bracket

5.25" to 3/4/5x 3.5"

2/3/4/6/8 Bay

Hard Drive Enclosure Internal 4/5 bay hot swap

Can also look up a BUNCH of 3D printable models of HDD caddys

I've also seen people bend some square u channel rails and drill holes to make internal HDD towers

Rackmounts

Suggestions by the community.

Supermicro

  • CSE-826 (12 bay hot swap)
  • CSE-836 (16 bay hot swap)
  • CSE-846 (24 bay hot swap)
  • CSE-847 (36 bay hot swap)

Additional Resources

r/Datahoarder and r/homelab have wikis that cover chassis, drives, racks, etc.

https://www.reddit.com/r/DataHoarder/wiki/hardware/

https://www.reddit.com/r/homelab/wiki/index/#wiki_hardware_guide

EDIT:

Thankyou for your suggestions. Adding as I see them.

7061
 
 
The original post: /r/datahoarder by /u/Ipwnurface on 2024-08-27 06:59:48.

Hey DH,

I like collecting hard to find/rare youtube videos. To this effort I crawl through playlists to find obscure, almost unseen videos.

I've done it for years and doing it manually is getting old.

Does anyone know of a way to take a youtube playlist (containing potentially 1000s of videos) and find which videos are unlisted?

I'm thinking there might be a way to leverage yt-dlp to do it, but I want to see if anyone else has already solved this before I bash my head against it.

7062
 
 
The original post: /r/datahoarder by /u/PossibleCertainty on 2024-08-27 04:56:34.

I have a little project going and could use a little help. What I'd like to do is take an old dvd copier case I have and use it as a hdd hub. The case has a good PS with 6 sata power outs, good ventilation, mounting brackets for the drives, etc.

The idea is to use the case and PS to house and supply the HDDs, while routing the data to the PC via USB. I thought I'd use a USB hub and then just do a p'n'p. The roadblock is I can't seem to find a good way to go from SATA to USB. I know adapters exist, but they are either plugs that include data/power or feature long cables like you see here:

https://www.ebay.com/itm/126198542704

Does anyone know the name of the part or a place to order a direct sata to USB convertor plug? I don't need pata or ide, nor do I need any length of USB. I'm hoping for a direct adapter plug.

Or could someone give an alternative option?

7063
 
 
The original post: /r/datahoarder by /u/trumee on 2024-08-27 03:57:00.

Hello,

I have a second linux server with a ZFS array for backup. This PC has IPMI (supermicro motherboard X10SL7) support using which i can turn it off or shut it down. I am leveraging syncoid to transfer ZFS snapshots to the backup PC.

I am wondering what is the best strategy amongst the following:

  • Turn backup server ON from primary server
  • Push ZFS snapshots from primary server
  • Send command to shutdown PC from primary server

or

  • Turn backup server ON from primary server
  • Pull snapshots from primary server
  • Send command to shutdown PC from backup server
7064
 
 
The original post: /r/datahoarder by /u/Terrible_Onions on 2024-08-27 03:46:12.

I need a External SSD (over 2TB) to store my 360 action cam footage in and I found the Canvio being really affordable. 4TB Canvio costs the same price as other 2TB SSD so I was wondering if the Cavnio was bad/ crappy.

If it is bad then any recommendations for 2TB SSD?

7065
 
 
The original post: /r/datahoarder by /u/talliquiem on 2024-08-27 03:37:59.

I'm just dipping my toes into preservation, so forgive my ignorance, but I've been waffling over this.

I've been decluttering and pulled out some of my magazines and have been thinking about getting a CZUR to scan them. Some are old enough to not think twice about it, but I have many that are more recent that had digital issues. Despite this, they can't be found anywhere to the best of my ability, whether it's through the internet archive or open directory searching. They existed at some point, but just haven't been uploaded.

Should I scan them even if, in theory, someone could very easily and quickly upload better images without scanner artifacts/binding skew? It's only time spent if that were to happen, but I was just wondering what others did.

7066
 
 
The original post: /r/datahoarder by /u/nikolajxo on 2024-08-27 02:44:48.
7067
 
 
The original post: /r/datahoarder by /u/trufflepuncher on 2024-08-27 02:23:41.

I have an 850, 860, and 870 all Evo in my collection, which one do you guys think is the best? I've heard some of the newer ones have a lot of issues and wondering which one to use in my system.

7068
 
 
The original post: /r/datahoarder by /u/OkOne7613 on 2024-08-27 01:19:35.

I've got to pull some ancient backups from tapes. Right now, I'm on the hunt for a drive that can actually read those tapes. Anyone got ideas on how we can make this happen?

7069
 
 
The original post: /r/datahoarder by /u/EmperorMeow-Meow on 2024-08-27 00:56:37.

Had a Crucial SSD that started popping off errors on my production files ( I am a photographer and graphic designer ) and also kept crashing my system. I eventually migrated the data off of the drive, but I need a reliable SSD to replace it with, but business is slow - and money is tight.

The process is: Shoot. Migrate photos and video RAW files from SD to Production SSD, edit images in Photoshop and save often large files ( Up to 200 GB .TIF files ), then import photos into an Illustrator file - design and export. Once project is closed, I migrate the files out of SSD onto a local hard disk and an offline drive.

The hitch is - when this Crucial SSD crashed, it started corrupting the RAW files AND the TIF files, and lemme tell ya - that was a nightmare, becuase it made the RAW files un-useable, and made video footage unuseable too.

Looking for a 4TB SSD. Speed isn't the priority, but it definitely needs to be faster than a HDD. I've been looking at WD SA510 4TB, and Samsung 870 EVO, Sandisk Ultra 3D. Also noticed some different names like FanXiang ( I am inclined not to trust it just from name alone ) and Teamgroup..

I need reliability and ideally a good cache to ensure that when I'm rushing to save a complex file before a thunderstorm - it doesn't take 15 mins.

7070
 
 
The original post: /r/datahoarder by /u/azeGDV on 2024-08-26 23:04:21.

Hi all,

I've spent a lot of time researching how to best digitize my collection of PAL-M VHS tapes. I've consulted the Wiki here, searched through this sub, and looked at resources on DigitalFAQ, AVForum, HTForum (BR), and other sites. My main challenge is the lack of high-quality reproduction equipment, and I’m hoping to get some advice on the best capture device or workflow for my situation.

Source Material:

  • All of my tapes are PAL-M VHS, recorded in SP (Standard Play) or EP (Extended Play) mode.
  • The tapes are not in the best condition, showing signs of age, but they hold irreplaceable family memories.

Previous Attempts:

  1. First Attempt: I used a Dazzle DVD Recorder when it first came out in 2004. At the time, my computer was underpowered and lacked sufficient storage space, leading to disappointing results (at least as far as basic capture settings I seemed to be going in the right direction).
  2. Second Attempt: About 9 years ago, I hired a highly-rated company in Brazil to digitize the tapes. Unfortunately, the results were underwhelming—similar, if not worse, than my first DIY attempt, with visible interlacing and compression artifacts (see image below).

This is the 'professional' capture I paid for almost 10 years ago

Current VCR Availability:

  • The VCRs I currently have access to are VHS-only models compatible with PAL-M—no S-VHS options are available.

My Goal:

I’m aiming to create a new, decent capture of these tapes—ideally my final attempt. Given the limitations (no S-VHS, older tapes), I’m hoping to achieve a result that closely resembles what you’d expect from watching these tapes on a standard TV: no persistent interlacing issues or noticeable compression artifacts, with the VCR making the necessary automatic tracking corrections during playback.

Looking for Advice:

Given these constraints, I’d appreciate any advice on:

  • Capture Devices: Recommendations for a device that can handle lower-quality tapes and work well with my available VCRs.
  • Workflow: Suggestions on the best capture process or settings to avoid common issues like interlacing and compression artifacts, given my equipment.

Thanks in advance for any guidance you can offer!

7071
 
 
The original post: /r/datahoarder by /u/Terakahn on 2024-08-26 21:43:20.

So I regretfully have not been the best at digital organization. Files, folders, bookmarks, playlists, etc. It's really a mess. It wasn't always, but you go through rough periods and just don't have the energy to keep doing it and get lazy and it gets out of control.

But short of going through everything, renaming and resorting them. Is there a shortcut to do this? A lot of it in miscellaneous named music files, files I've downloaded that come with random names, etc.

I think the last time I attempted this I was going through every old browser bookmark and it took me a week spending a couple hours a day just checking each one, seeing if the site was valid, and appropriately renaming and putting it into a folder. But I'm loathe to do that again if I can avoid it.

Edit: Additionally I've noticed some of my old TV shows have corrupted files, or parts of the video will be unplayable but I don't know if that was already like that when I got the file or if it happened afterwards. If I had a way to detect things like that it would be great too.

7072
 
 
The original post: /r/datahoarder by /u/Lvcrmnr on 2024-08-26 20:44:34.

Hi everyone,

Since 2010, I've always did backups of my phone camera roll/data, documents, downloads, etc... in multiple drives and without deleting anything, haha!

But I always did that manually, copying and pasting files in Windows Explorer from phone and computer directories to external USB/docking station SATA HDD...so I feel like a total newbie by reading posts here.

I currently own 2 "fairly new" 4TB drives (around 2 years old). One is a Toshiba EHD USB and the other one is a SATA Seagate Barracuda.

Since I want to feel even safer, I was looking to buy a SATA WD Red and copy everything even in that drive, and keep it away from my home, maybe locked at my office. I am always scared of thieves/house burning down lol. I know I'm mental but photos and videos of my whole life are priceless to me...

Since I feel like I still don't know anything I was looking for suggestions here. Maybe a software like Acronis or using a better file manager like Total Commander? Maybe buying this third drive and copy-pasting using Windows is not safe for data integrity? I know that the cloud would be the best but 4TB is quite expensive and will take forever to upload.

I was also going to buy a WD Elements USB disk but I read in this sub that they use proprietary motherboard connectors and are hard to connect if something bad happens to the USB port.

BE AWARE that my files are not frequently updated, but most of the time I'm just duping my phone into drives and then deleting...so maybe a software is not necessary?

Should I also checksum my phone files after copying them?

Thanks in advance, looking to learn more here!

7073
 
 
The original post: /r/datahoarder by /u/Main_Razzmatazz5283 on 2024-08-26 20:14:50.
7074
 
 
The original post: /r/datahoarder by /u/ApertureNext on 2024-08-26 19:06:50.

I want to hash files locally on each device, and then take the two resulting files with hashes and paths to compare.

My problem is that no widely accepted solution seem to exist, many scripts I can find are quite old, etc.

Does any cross-platform solution exist for this problem? Does two different pieces of software/scripts for Windows and Linux exist which creates checksum files in the same way so they can be compared easily?

My NAS solution does not do checksums, and I can't re-transfer the data from the Windows PC.

7075
 
 
The original post: /r/datahoarder by /u/FlowerInDawn on 2024-08-26 19:04:49.

Anyone having the same problem with the newest version?

view more: ‹ prev next ›