It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
8826
 
 
The original post: /r/datahoarder by /u/BeMetalo on 2024-06-24 14:54:09.

I have a lot of old/vintage hard drives (think Quantum Bigfoot and some 10,000 RPM Drives), but I would like to securely erase them before selling them.

None of them have anything crazy (financials or things like that) on them. I just want them to be erased (at least 2 passes) so that the average person cannot recover them.

I have both Mac and PC.

Thanks!

8827
 
 
The original post: /r/datahoarder by /u/AccidentalNGon on 2024-06-24 22:53:27.

Over time, my family and I have used several different brands of phones from iPhone, Galaxy, and Pixel. They all save their photos with a different naming convention. iPhones seem to be the most useless, with IMG_[INCREASINGNUMBER] as the file name. No information as to when it was taken. Pixel comes in second place here, with filenames being PXL_YYYYMMDD_HHMMSS[Milliseconds]. Samsung has the most usable naming convention out of the box, with YYYYMMDD_HHMMSS.

Unfortunately, this means that all of our photos are completely out of order when placed in the same folder. Samsung photos come first, then iPhone, then Pixel.

Bulk Rename Utility can rename files based on EXIF metadata. However, not all of our photos retained their "time taken" information (and I am unsure as to why this is), especially the ones taken on iPhones. How are you supposed to organize your photos properly?

8828
 
 
The original post: /r/datahoarder by /u/adckw on 2024-06-24 22:40:30.

Hello, I’ve had this recurring thought about news media orgs shutting down, and I figured here would be a good place to start with my questions: How would you go about archiving a news media website’s content — think NPR, or BuzzFeed News, for example? Local storage options?

Thank you

8829
 
 
The original post: /r/datahoarder by /u/ExtremeConnection26 on 2024-06-24 22:05:17.
8830
 
 
The original post: /r/datahoarder by /u/wizzycat on 2024-06-24 21:27:21.

I have been watching YouTube videos and scrolling through Amazon reviews and Reddit posts for hours, still at a loss for which external hard drive to buy. I also tried to understand how the Backblaze stats could apply to my search, but I was unsuccessful. I don't care so much about speed or anything; I'm primarily concerned with avoiding data corruption and loss. I like the idea (and price!) of a 2TB external hard drive, as I am only planning on storing my music, pictures, videos, and documents. I have heard it is good to have both an SSD and a HDD external hard drive. Is that true? I want to purchase two external hard drives, and I am unsure if I should buy two of the same model or two different. All I'm really looking for is reliability. Also, how often should I replace a 2TB external hard drive? And could someone recommend a retailer that I can trust to ship very carefully?

BTW, the current external hard drive I have is a 2TB Toshiba DTB420. It worked well for many months, until recently it has not been safely ejecting unless I go to command prompt>disk part and offline-ing the hard drive. And I really don't mind doing that; I'm just worried about it eventually leading to the problem of corruption or complete failure, and subsequent file loss.

Thank you so much. Any help means so much to me!

8831
 
 
The original post: /r/datahoarder by /u/xSleekx on 2024-06-24 20:18:07.

I have above a thousand mp3 files in a folder and none share the same file name but many share song titles. And to be put simply is there a free tool that can scan for those duplicates and remove them?

8832
 
 
The original post: /r/datahoarder by /u/Raghavan_Rave10 on 2024-06-24 20:17:09.
8833
 
 
The original post: /r/datahoarder by /u/F12forBIOS on 2024-06-24 20:13:44.

I started a RoboCopy transfer this morning to an HDD connected via USB. It got to 40GB after about 5 hours and I checked the log.txt to notice that it hasn't moved from a certain file.

I will need every single file transferred and as quick as possible (even if that takes a week)

Currently I am using

robocopy e:\source h:\destination /E /DCOPY:DAT /R:0 /W:0 /LOG+:C:\temp\robocopylog.txt\

I've killed the RoboCopy task and modified the command numerous times and don't see much of a change, so I am asking for the best commands to simply let this transfer in the background without me having to check on it every hour.

I tried adding /MT and that brought over hundreds of subfolders but no files. Still stuck at 40GB an hour later.

8834
 
 
The original post: /r/datahoarder by /u/Air-Flo on 2024-06-24 20:03:49.

Set up my first NAS last week and was looking around at drives for backups. Was comparing Toshiba N300 16TB and WD Red Pro 16TB, the Toshiba drives are much cheaper but have a few lower specs (Which probably don't make a major difference).

However, I also noticed the Toshiba has a 3 year warranty whereas the WD Red Pro has a 5 year warranty, which meant the WD was cheaper over a 5 year period than the Toshiba is over a 3 year period.

Not that I'm expecting the Toshiba to crap out at the 3 year mark, but how much weight you put on warranty when buying a drive? But I've also read plenty that Toshiba's warranty sucks, and WD's is going downhill.

My NAS has 3x8TB drives in SHR (or RAID5), and my plan is to eventually get another 8TB drive (4 drives total, 24TB usable) and a second 16TB drive for backups (2 drives total set to JBOD, 32TB usable). Then eventually get a second NAS, a third 16TB drive, and have a separate array (3x16TB).

So having a couple extra years of warranty seems worth it when it eventually gets put in an array. I see this as a good way of scaling without buying external desktop drives which inevitably stop being used because they're too small to be useful for my needs.

8835
 
 
The original post: /r/datahoarder by /u/Kaleidoscope_Weird on 2024-06-24 18:48:26.

Hi there, I'm looking for some brainstorming help around what might be my best options for long-term data storage and security. Currently, I have a few computers I'm running at my home at the moment ... Macbook Pro M1, Mac Mini M1, Mac Pro 2013 (Yes, the trashcan edition), and I also have a random HP laptop that I use for the few things I cant do with my Apple devices. My storage solution in the past has been having a 5TB HDD MyBook for all my CDs that I've archived, another couple 5 TB external HDDs for photos, and a few random 500GB or 1TB SSDs for this that and the other thing.

Let me summarize. I have TOO MANY F&$%ING drives! I've had one completely fail, a couple that have come close to failing, I've lost an important one ... I think you get my jist. My storage solution is less than efficient, less than secure, less than ...

I'm wanting to consolidate my data onto one system that I can access from all of my computers at home, and if I can access it, on occasion, remotely, that would be amazing. I'm happy to connect directly to my Mac Mini at home (I'd venture to say that's the best computer to do so) to spare the increased cost of a NAS. I've been doing some research and I'm strongly considering the Terramaster D8 Hybrid that has just been released ... which will more than fill my storage requirements, and provide me with a RAID storage solution so I (hopefully) won't lose any more data in the case of a hard drive failure. (It can handle 4x24TB HDDs as well as 4x8TB NVMe SSD drives)

I'm figuring I have approximately 15 TB of data that I would really would like to not at any point lose, that number likely increasing as time goes on.

The other consideration is that money IS an object in constructing this system. I'm happy to see that hard drives are coming down in price a bit, however I'm wondering if constructing this system with refurbished drives, at least to start, might be a not bad idea, or is it really in my best interest to go with brand new drives or am I safe purchasing "renewed" drives, such as Seagate Ironwolf Pro or WD Red drives from Amazon? Or are there better sources for high quality renewed drives?

I'm sure that's not all the quesitons I have, but the main ones that are swirling in my personal RAM at the moment. Thanks for reading this novella, and I welcome any advice any of you are able to provide.

8836
 
 
The original post: /r/datahoarder by /u/ImaginaryCheetah on 2024-06-24 18:47:05.

been looking into going smaller and more energy efficient, but i'm cheap, so i was looking at N100 boards on aliexpress. i've looked for a while, and never seen these boards from SZBOX before - onboard 2x2.5GbE and 1x10GbE ports, plus 2xNVME and 6xSATA.

anybody got their hands on one of these ? i can't find any reviews for this specific board outside of aliexpress and google is just clogged with misses searching for board specs.

the 10GbE is way more useful for me than 4x of the 2.5GbE ports that the other N100 NAS boards have.

8837
 
 
The original post: /r/datahoarder by /u/TheRealistDude on 2024-06-24 18:16:32.

Hi, looking for a 1TB cloud storage. Short of funds otherwise would have bought an external hdd.

Anyways, found idrive and mega to be good with the prices (Anyone has any recommendation?)

But how do I safely upload? I know every cloud storage blatantly scans the files but still I want a bit of security.

Do I just use winrar to "add to archive" the files and protect it with password?

Thanks.

8838
 
 
The original post: /r/datahoarder by /u/Pmur0479 on 2024-06-24 17:39:35.

I'm looking to buy my first large drive, a 12TB refurbished HDD. I am on a budget so I am wondering what are the expert opinions on these (in order from cheapest to most expensive):

HGST Ultrastar DC HC520

HGST Ultrastar He12

Seagate IronWolf

Seagate BarraCuda Pro

Western Digital Ultrastar DC HC520

If you were in my shoes, would you go for the cheapest one? Any insights or other suggestions appreciated, thanks.

8839
 
 
The original post: /r/datahoarder by /u/Electronic-Tap-4940 on 2024-06-24 17:25:46.

Hi all

I have a 5yr old white label 10tb drive which suddenly dropped from the array. First i thought i could reseat, redo cables etc to fix, but it wont be discovered.

I have tried connecting it externally to my laptop, swap to different bays in hotswap and checked the loadup with the asm1166 where i see all drives load up except for this one.

What confuses me is that the drive powers up and everything, i just cant access the data on there. Is the drive dead?

Hopefully someone can help..

8840
 
 
The original post: /r/datahoarder by /u/Bonebaaz85 on 2024-06-24 16:43:59.

I know how to do it on android but not on ios. I tried the famous save bot but its not working now…any ideas?

8841
 
 
The original post: /r/datahoarder by /u/echae on 2024-06-24 16:26:26.

The website prcm.jp a formerly huge japanese image sharing site is shutting down at ‘june 26 12 am’ likely japanese time and I’m worried at how much media will become lost as they mention all images posted will be deleted, this website is a great way of finding selfies and fanmade collages and such that japanese people or more notably celebrities and jpop singers that we love post so I feel like the jpop fan crowd needs to be aware of this. Alot of the images are unavailable anywhere else google doesn't compare.

I'm not in this sphere of archiving websites I don't know anything but it's bringing me turmoil so I’ve tried archiving a few pages of this site using the archive/waybackmachine there’s not much I as one person can do. I hope this reaches a wider audience and this site can be properly preserved.

8842
 
 
The original post: /r/datahoarder by /u/ostrichsak on 2024-06-24 15:54:30.

I just ordered some (6) retired data center 12TB HGST 12TB HDDs that are due to arrive tomorrow. I plan to test them for proper function and then deploy them in my DS920+ running SHR-2 (for 2-drive failure protection) and then the other two will go into external enclosures for 3-2-1 b/u use.

What I'm looking for is an inexpensive external HDD enclosure for this purpose. I want something that doesn't come with any need to hack firmware or other time consuming micro-managing that I don't want to deal with on a brand new product.

I've read that having a fan is a good idea. My network rack where this is going to be located maintains a consistent temperature below 65° so I'm not sure how important that is. Happy to hear input on if I should make this a requirement or not but it seems like it might be a good thing to have... less the added power usage and dust movement from something that may or may not actually be needed.

I've read that I also want something that has a physical power switch so it spins back up should power ever be lost. I don't anticipate this being an issue with my current s/u but if it's something that could save me headache should my set up change in the future I'd like to future-proof myself.

I also like the idea of something that isn't too large or has too many moving parts or anything to worry about for transport. My plan is to rotate one off-site weekly and I'm concerned about some that I've seen with big hinged doors and what not. Seems handy for quick access but I really don't anticipate swapping drives in and out of the enclosure often enough to make that a handy feature for this need. I think that the door popping open during transport would be more of a concern than a benefit.

All I really care about is performance. Something with a solid, reliably USB interface that nets top speeds for large data transfers from my NAS to the HDD is near the top of the list along with low price. I'm guessing I can fit the above criteria into something costing ~$20 but want to get something the community feels is trusted.

Thanks for the input!

8843
 
 
The original post: /r/datahoarder by /u/The-Wire0 on 2024-06-24 15:40:43.

I have an issue of organisation in real life, inevitably this also means the same issue in the virtual world.

I have personal generated data, such as pictures, text files, word documents etc that are littered everywhere in this computer drive.

I was wondering if there's a tool who can tell apart the personal generated data from OS files, and possibly also program files? The most, if not all of my programs are backed up in the cloud elsewhere and they're not irreplaceable if lost.

It's personal generated data that's the problem.

8844
 
 
The original post: /r/datahoarder by /u/techyderm on 2024-06-24 15:16:33.

Setting up my NAS for the first time with two 12TB drives, one WD Red Plus and one Seagate Ironwolf.

Both are matching specs (12TB, 7200 RPM, 256MB Cache) and badblocks been running for the past 5 days with both running at the same time in tmux.

However, the Seagate has finished and the WD has just started writing the last pass (so, Seagate finished 25% more quickly). Both have no errors.

Just curious what the experts here think about that. A fine thing so long as no errors, or cause for concern? Even if not concerning from a reliability standpoint, is it from a general quality pov?

8845
 
 
The original post: /r/datahoarder by /u/F12forBIOS on 2024-06-24 13:18:07.

A few months ago I used Windows Explorer to transfer between two servers. It took approx. 3 weeks to transfer 13TB before it crashed around 85%. This was from network drive to network drive.

Last week I started a TeraCopy transfer of the same 13TB to a local hard drive plugged in via USB. No more network drives which I believed to be the reason why it was slow. 5 days later and TeraCopy just began finally transferring the files, giving me an estimated completion time of over 800 days. It's transferred just 1% of the files.

I've added TeraCopy to my exclusions list in Windows Security but it hasn't improved the speed. I just paused it and initiated the transfer over RoboCopy, however there is no completion time as everything is being written to a log.txt that I have to keep re-opening to check the status. There is no percentage or estimated time.

Any suggestions? I'm not expecting this to be done over night. I was just hoping it wouldn't take more than a week or so. Again, this transfer is being done locally to a 18TB drive.

8846
 
 
The original post: /r/datahoarder by /u/utzcheeseballs on 2024-06-24 12:00:42.

Hello fellow hoarders. I'm just beginning my journey and building a collection of movies and music through cd and Blu-ray purchases. I'm using a mini-pc, N100 as the "brains", which hosts my small collection (<5 TB) via a USB attached drive 24/7 through Jellyfin. I'm very happy with what I have so far, but I also want to plan for future expansion and have a disaster recovery plan. I'm looking for feedback on data storage options, specifically, NAS vs. DAS (but open to other solutions).

Current setup:

  • Private network only, using Jellyfin.
  • User access is 1-3 users: family members under my roof. I'm not looking to share my media with anyone else.
  • I'm the only user requiring access to the file storage via methods other than Jellyfin. For example, I'm using SMB to gain access to media shares from my devices; TeamViewer when I need to perform admin tasks. I'm happy with this setup so far.
  • Cloud backup of USB drive

Future possibilities:

  • I may want to connect to Jellyfin from outside my network at some point.
  • Space expansion obviously. Right now, I own a very small collection, which will likely remain under 5 TB for the next year or so. My thought is something that can do 8-12 TB and maybe more down the road.
  • I may want to move away from cloud storage altogether and own the entire process soup to nuts.
  • I would like to have a RAID setup. Never had one, and I'm doing research - so not looking for any specific feedback here, only that the storage option keeps that in mind.

Looking forward to your feedback. Thank you.

8847
 
 
The original post: /r/datahoarder by /u/vassett on 2024-06-24 10:44:19.

some sites like annas-archive let you download lot of books in single torrent but i'm only intrested in one category and would like to know if there's a site that gives you the option to choose

8848
 
 
The original post: /r/datahoarder by /u/beingbond on 2024-06-24 10:42:30.

I tried searching it but most of solutions are 3+ year old which no longer works. I know very little of wget( used it more tha 4 years ago) or other script btw.

8849
 
 
The original post: /r/datahoarder by /u/maximumkush on 2024-06-24 10:14:02.
8850
 
 
The original post: /r/datahoarder by /u/Sea-Researcher-353 on 2024-06-24 09:50:18.

Hi All, Could you please advise which external SSD should I buy and why? Kingston XS1000 1 TB or Samsung T7 shield 1 TB or Adata elite SE880 1 TB?

Please feel free to suggest others in this category

Thank you

view more: ‹ prev next ›