It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
2251
 
 
The original post: /r/datahoarder by /u/Deep-Egg-6167 on 2025-04-06 14:53:37.

Hello,

I can't seem to find this part on Seagate's web page so I'm wondering if it is legit. I may contact Seagate but thought I'd ask here.

2252
 
 
The original post: /r/datahoarder by /u/welovett70 on 2025-04-06 12:19:26.

I’m trying to expand my Dell Precision 3630 (i7-8700 CPU)to support 3.5” HDDs larger than 8TB, but I’m running into an issue where drives above 8TB are not recognized in BIOS.

Current Setup:

  • Storage:** 1TB SSD (SATA) + NVMe drive installed

  • BIOS Version:** 2.31

  • SATA Mode:** AHCI (confirmed enabled)

  • Power Supply: 400W 80 Plus Gold PSU

  • Drives Tested: 12TB & 14TB HDDs (formatted with Btrfs on Proxmox)

Troubleshooting Steps Taken:

  • Checked BIOS settings – All SATA ports are enabled, toggled them off/on.

  • Tried different SATA cables & ports – No change.

  • Confirmed AHCI mode – Not running RAID or Intel RST.

  • Drives work fine via USB DAS – But not when connected via internal SATA.

Questions:

  1. Should the Precision 3630 be able to recognize drives larger than 8TB via SATA?

  2. Is this a known BIOS limitation, or could it be a power delivery issue?

  3. Would a PCIe SATA controller bypass this problem?**

  4. Any recommended BIOS settings or firmware updates that might help?

Would appreciate any insights from those who’ve dealt with large HDD compatibility on Dell workstations!

2253
 
 
The original post: /r/datahoarder by /u/su-do_nym on 2025-04-06 02:36:49.

Any recommendations for a cloud server with lots of storage space that you can buy a lifetime plan for?

I want to specifically store all my photos on it so I would need to be able to run immich on it.

2254
 
 
The original post: /r/datahoarder by /u/T-nash on 2025-04-06 13:43:43.
2255
 
 
The original post: /r/datahoarder by /u/SuperCiao on 2025-04-06 09:31:05.

Hi all,

I'm seeking the most robust and verifiable method to copy large video files (ranging from 10 GB up to 200+ GB) to an archival storage setup on Windows 11. Ensuring data integrity and transfer reliability is paramount, as these files are intended for long-term preservation.

My storage configuration includes:

  • 2 Western Digital Gold 8TB internal HDD, formatted as NTFS, dedicated to cold-archival purposes.

In my previous attempts, I utilized Python scripts employing the built-in shutil.copy() function to automate the copying process. However, I encountered challenges related to performance and data integrity:

  • Performance Issues: The default buffer size in shutil.copy() led to slower transfer rates. Adjusting the buffer size improved performance, as discussed in this Stack Overflow thread.Stack Overflow+1Python Central+1
  • Data Integrity Concerns: There were instances of file corruption post-transfer. It's been noted that shutil.copy() may not handle large files optimally, and ensuring data integrity requires additional verification steps, such as hashing.

Given these challenges, I'm exploring alternative methods and have the following questions:

  1. Recommended Tools: Beyond Python's shutil, are there more reliable tools like robocopy, Teracopy, or FreeFileSync that offer built-in verification mechanisms to ensure data integrity during large file transfers?
  2. Verification Practices: Is performing a post-copy hash check (e.g., MD5/SHA256) advisable for large files, or are the verification features in the aforementioned tools sufficient?
  3. Filesystem Considerations: Are there specific NTFS settings or configurations that optimize the handling of large sequential files on WD Gold drives?
  4. Write Caching and Ejection: Should write caching be disabled for these drives, and is it necessary to safely eject the external drive after each transfer session to prevent data loss?
  5. Power Interruption Safeguards: What measures can be taken to protect ongoing transfers from power interruptions, especially when using external USB drives?

My priority is accuracy over speed—ensuring that each file transfer is bit-perfect is more important than the duration of the transfer.

I appreciate any insights, recommendations, or shared experiences regarding best practices for securely and reliably transferring large files in a Windows environment.

Thank you!

2256
 
 
The original post: /r/datahoarder by /u/Reasonable-Law2411 on 2025-04-06 07:05:54.

I'm searching for a reliable TikTok HD video downloader that doesn't add watermarks to downloaded videos. While there are numerous options available, I'm interested in finding the best downloader?

Im currently using: https://www.tiktokfetch.me/

2257
 
 
The original post: /r/datahoarder by /u/Kazozo on 2025-04-06 06:43:58.

Will be using it for daily regular backup as an attachment drive. Nothing intensive. Regular office work and some slow tormenting on.

HUH728080ALE601

5 Year Warranty Card (probably not applicable? But they included this)

HGST 8tb, Refurbished with 90 day refund/replacement

Ships from : Amazon

Sold by : WorldWide Product Importer

Around 130 USD

NOTE -These HDD is used by Datacenter Servers for about 3 Years period. HDD was refurbished and data wiped with DoD standard. It's fully tested & passed HGST factory diaGnose software test. Since this is heavy duty enterprise HDD with a 2.5M-hour MTBF ratinG.

8TB, 128MB Cache, 7200RPM, SATA III 6.0Gb/s - DesiGned for 24/7/365 Heavy Duty, 2.5M-hour MTBF

2258
 
 
The original post: /r/datahoarder by /u/BreadfruitExciting39 on 2025-04-06 06:41:50.

This post is meant to serve as a warning to others like me in the future.

I have had two WD red drives in a Buffalo LinkStation LS421DE, running in raid 1 for quite a few years. I started running out of space, and want to move to a cloud backup anyway (so the raid redundancy isn't as important to me anymore), so I decided to move to just a bunch of drives with no raid array.

Genius me thought "backup the data, shutdown the NAS, pull a drive, boot it back up and delete the array, shutdown and reinsert drive, and I'll have two separate working drives and one will retain all the data".

Turns out this NAS didn't like that. When I rebooted with the 2nd drive reinstalled, everything stopped responding and the NAS went into "Emergency Mode." It took me an hour of messing with it and resetting this & that to figure out that the drives have to be partitioned and formatted from scratch in order for this NAS to recognize them. When I destroyed the array with only 1 drive installed, the NAS repartitioned and formatted that one fine. But it just completely froze up when trying to setup the 2nd drive that still had data.

Hoping to save someone a headache in the future. Just back it up & blow it all up (or buy a better NAS and avoid the headaches altogether).

2259
 
 
The original post: /r/datahoarder by /u/Abdel403 on 2025-04-06 04:04:30.

First, please don’t mind my technical jargon, I’m a regular consumer not a pro. Don’t work with and save data daily, just need to have a simple and easy enough way to do this without becoming an expert :)

Here is my situation and my problem (if it is!): I have saved all my personal data (under 1TB) of all sort since years in an external HDD, and just recently bought an external SSD (SamsungT7 shield) as another backup media, ext-HDD would become now the final destination. So, historically, whenever I have modified a file or have new files on my computer, I would transfer them and save them in the ext-HDD, but it’s a slow device and goes to sleep etc, so not very user friendly and not as fast as of working on a computer. So now that I bought a fast ext-SSD, I will use it as a first backup, which have fast transfers with the computer. Then once in a while, I will backup the ext-SSD into the ext-HDD.

My old and conventional method was to remember the location of the modified files and overwrite them in the ext-HDD and sometimes create new folders for new files, using sample Windows copy/paste or drag to move and save stuff on the final backup media. Not sure if there

  1. But, if I don’t want to do that between the ext-SSD and the ext-HDD, and instead of a full copy between the two drives, which will take hours, is there some ways and softwares that will update and re-work the external HDD for only the modified folders and files to match the external SSD ? a program that will just scan the ext-SSD and check what are the difference in folder structures/names and files and only make copy the modified ones and make the new folders and such, comparing file sizes, dates and other parameters to make sure to not touch the exact same ones.
  2. Or is it safer and most efficient just to copy the entire SSD into the external HDD every time, which more likely will take hours.
  3. Do some of those programs have the options to optimize the space on the drives? like defragmenting and do a better grouping and such? I noticed that the HDD actual files size and actual on disk storage size is very different, while the T7 SSD seem to have them very close to each other.

Pleas advice what should I do and what few free softwares are available for both cases?

Thank you!

PS: I’ve put in my notes the name of few softwares that I stumble on over time but never looked into them yet and probably each of them is for different applications, like:

Clonezilla

Macrium Reflect

terabyte unlimited Image backup restore suite

Aomei backupper

Rsync

Freefilesync

syncfolders

robocopy

borgbackup

Veeam Agent

CrystalDiskInfo

Ddrescue

Acronis

CZKAWKA

Carbon Copy Cloner

Super Duper

soft raid

Duplicati

Duplicacy

Raise data recovery

R-studio

Getdataback Pro

ufs-explorer

DMDE

2260
 
 
The original post: /r/datahoarder by /u/Appropriate_Day4316 on 2025-04-06 02:40:56.

Original Title: I have WD My Cloud NAS with two 12TB drives bought a year ago as refurbished. The system showed one drive as BAD. After reboot the flag dissapeared and it is now showing GOOD. I have apportunity to RMA and get replacement. What do you think?

2261
 
 
The original post: /r/datahoarder by /u/venjah on 2025-04-06 02:40:39.

Hi, I've got a question. Like the title said, I have a 4TB Seagate Backup Plus portable HDD that I've been using as a backup dump for all of my personal files for a few years now, and only recently have I started to pay more attention to my HDD's usage and trying to prolong its lifespan a bit before investing in a new drive in maybe a year or two.

I've seen some posts in this sub regarding keeping external HDD's plugged in at all times, but mine is not a "heavy duty" requires external power source type of HDD like the ones in the other posts, so I'm not exactly sure if the same answers apply. Should I only plug my portable HDD into my laptop when I need to use it and unplug right after use, or is it safe for me to keep it plugged in?

2262
 
 
The original post: /r/datahoarder by /u/Economy-Repair8926 on 2025-04-06 02:38:45.

ive tried all the ways to do it but i cant figure it out

https://web.archive.org/web/20201125075954/http://www.itsaturday.com/

i would be very grateful if someone could

2263
 
 
The original post: /r/datahoarder by /u/S4P on 2025-04-06 02:38:13.

Can someone help me and tell me what this noise is? Noise is new and wondering if my HDD is on its way out. Anything else I can check (see below)?

  • Its a ST18000NE000-2YY101.
  • chkdsk /f /r /x was fine
  • 100% health from Hard Drisk Sentinel
  • 1001 power on days; 3,135 stop/start count
2264
 
 
The original post: /r/datahoarder by /u/Character_Mobile_160 on 2025-04-06 01:40:48.

I've read in a few threads that 7z is not good for backups, but I can't really remember what the reasoning was. Maybe corruption, although I would think that any file is prone to that which is why I would be backing up anything important on multiple drives instead of just one, but I'm also very new to this field since my hard drives are now reaching their 11 year marks, I think it's long past the time I should be backing things up.

The most important things to me are project files from music production, like Ableton project files, which can be anywhere from 4MB to 2GB each (and there are almost 2000 of them so this whole folder is about 90 GB), along with more folders with just thousands of audio files (about 6000)

I don't often rely on clouds for backups but instead I just get new hard drives and make copies of data on them. But as for moving around these large folders between computers, it would be huge transfers, and 7z can infact compress audio files by a bit. Would it be worth it for these backups or should I just back them up raw? Or is another format better (like tar along with a compression method like xz)

2265
 
 
The original post: /r/datahoarder by /u/docnstuff on 2025-04-05 23:03:25.

Hello, I have recently started consultancy.

I have many years dealing with management systems on unorganized servers and I want t pl get away from that pain on my own.

With all the modern Microsoft 365 packages now to my own account.

I would like to get to a flat storage system for my central management system but would also like to do the same for my client.

So my question is what is the quickest and easiest way to remove single files from huge folders within folders within folders? Dragging folder from each project folder will just take forever.

Also is there an easy way to take the information within each file to add to share drive columns.

I would love to have a means to easily get the information I need and take from it what I need. I also believe it be better value to my client that I'm not just spending hours and days just moving data and classifying it.

Any help or assistance would be greatly appreciated!

Thanks in advance

2266
 
 
The original post: /r/datahoarder by /u/NadiaN98 on 2025-04-05 21:16:09.

Hey guys. I'm looking for a program for Windows that allows me downloading from youtube and has an extension like the one IDM has that appears on top of each video and allows me to dl a video directly from the different qualities available.

IDM works for a couple of days and then doesn't for a month until it gets updated. I have Jdownloader too but it needs importing cookies and logging in all the time and it's not just as smooth and quick as IDM.

Any help will be appreciated. Thanks in advance.

2267
 
 
The original post: /r/datahoarder by /u/georgosnero on 2025-04-05 23:10:06.

Hey y'all. I want to download a concert live that's locked behind a paywall. It's a concert live from Zaiko, and I've already paid for the digital ticket a couple of days ago. It's a great live, and I'd like to have it in my personal collection since this band hasn't released any live concert videos, aside for a couple songs.

The problem is downloading it. I have seem a guide here before on downloading it, but have yet to try it myself. I know downloading stuff that's locked behind something is quite complicated, and I'd like for someone to show/guide me into doing it. Thanks!

2268
 
 
The original post: /r/datahoarder by /u/grinder323 on 2025-04-05 21:37:25.

So my backup drives contain full copies of all the data on my in use drives, however over time, I have made organizational changes to my drives, that have not been reflected on my back ups (as this take hours upon hours to do). assuming that the individual file names are the same, is there a program out there that will allow me to copy over the these organizational changes to folder structure quickly without having to manually move things around?

2269
 
 
The original post: /r/datahoarder by /u/TreverCarreon on 2025-04-05 20:13:23.

I’m a video editor with a newfound need for some pretty serious storage options.

I know nothing about any of this but am looking into getting a NAS drive that’s as plug and play as possible.

Expandability is also important. I thought it would be as simple as typing in “6 or 8 bay NAS” and going from there but the vast number of options are intimidating for something so important to work.

Can here anyone point me in a direction?

I know basically nothing about any of this and just need an expandable drive to pull files from.

I’m worried about buying the wrong generation or a subtly incorrect model number. It seems like there’s a lot to these.

EDIT: also WHERE to purchase? Can these be bought safely used?

2270
 
 
The original post: /r/datahoarder by /u/zkribzz on 2025-04-05 19:13:57.
2271
 
 
The original post: /r/datahoarder by /u/c9898 on 2025-04-05 18:18:39.

I missed the golden age of $6-8/TB refurb hard drives, it doesn't look like it will get better any time soon, and I need storage now... what options do you guys recommend?

  1. ~$10/TB refurb from sellers that have a history selling/testing hard drives but offer no warranty
  2. ~$13/TB refurb from serverpartdeals/goharddrive with 1-5 year warranty
  3. <$9/TB used from private sellers
2272
 
 
The original post: /r/datahoarder by /u/FLX on 2025-04-05 17:07:16.

I have a USB HDD from my late father full of photos. When starting it up, I hear the head clicking, but nothing else happens.

I'm wondering if there's any data recovery service that you would recommend online, where I can ship the HDD to and for them to make the data available. Alternatively a good data recovery service in the SF Bay Area. Thanks!

2273
 
 
The original post: /r/datahoarder by /u/Slackdarren on 2025-04-05 16:40:13.

Is there any software i can use to use on my photograph library. Wanting to hopefully id people on other photos, allready id. Maybe recognise words as well.

Thanks

2274
 
 
The original post: /r/datahoarder by /u/Nearby_Acanthaceae_7 on 2025-04-05 16:36:27.

Hey everyone!

A while ago, I shared a simple project I made: a basic, self-hosted GUI for yt-dlp. Since then, I’ve added quite a few improvements and figured it was time to give it a proper update post.

  • Docker support

  • Cleaner UI & improved responsiveness

  • Better error handling & download feedback

  • Easier to customize and extend

  • Small performance tweaks behind the scenes

GitHub: https://github.com/developedbyalex/basicYTDLGUI

Let me know what you think or if there's something you'd like to see added. Cheers!

2275
 
 
The original post: /r/datahoarder by /u/searchjobs_poster on 2025-04-05 14:54:02.

Is there a website where you can download videos, audio, images, and more from various social media platforms? Dont want to save/bookmark different websites for different social media sites. I know that its hard to find some, but not looking for command-line tools at the same time. The simpler it is, the better.

view more: ‹ prev next ›