It's A Digital Disease!

The original post: /r/datahoarder by /u/kap-abel on 2024-10-10 02:12:28.

Hi there.

I have a local disc of 500GB. I have an external drive with 1700GB and have tu upload this onto my 2TB Google drive. I use cp -R to copy the files because the disc is corrupted (long story, when copying via Finder I get a transmission error).

The problem is that my local disc gets filled up and then cp -R errors out that there isn't enough disc space available.

I can't change the streaming location in the google drive application because I am on a Mac.

What can I do?

The original post: /r/datahoarder by /u/AntarcticNightingale on 2024-10-10 00:18:02.

The original post: /r/datahoarder by /u/Clean_Cobbler_7319 on 2024-10-09 23:25:56.

My dad refused to listen to me when I told him, what he was buying was in actuality a NAS and not a normal external hard drive, up until recently he thought all external drives were the same.

So, he gave it to me (Yay) problem was he had already set it up that every time/anytime it overheats and shuts down, he gets an email to tell him it has shut down, my dad has a hairline trigger for anger.

I updated the fans inside, as far as I know they are industrial strength, and the unit is no longer kept in a cupboard, it's well ventilated, but it still happens from time to time.

I have looked online and not found anything to remove/change the email address, without either wiping the unit or reformatting and starting all over again, plus he had no idea the setup process would be so complicated for him and made it so it only works/mounts as a Guest account there is no username or password.

The original post: /r/datahoarder by /u/SlutBuster on 2024-10-09 23:24:16.

I keep my work on a 4TB M2 SSD drive, and it's starting to fill up. So I picked up a second 4TB drive to stick in the extra M2 slot on my MOBO. I'd really like to just extend the storage of my "work" volume to 8TB, rather than adding another drive letter and splitting the files between the drives.

I know I can use Disk Management to extend the volume to use both disks, but my understanding is that if one disk fails, the whole volume disappears. So I'm wondering if there's a more crash-friendly option that won't require me to restore everything if one drive goes down.

The original post: /r/datahoarder by /u/dp655321 on 2024-10-09 19:41:09.

Good day everyone. I recently damaged my WD EasyStore 20TB drive while it was plugged in to my desktop. I had it on an uneven surface and it slipped on its side. My desktop can no longer recognize the drive. I took it to a data recovery company near me but they couldn’t fix the drive or recover the data because the drive is hermetically sealed with helium. The heads have been knocked off course, and without being able to open and replace these damaged components, there is no path to the data.

Has anyone else experienced this issue and found a solution? Are there any companies that can troubleshoot despite this issue?

Thanks in advance!

The original post: /r/datahoarder by /u/john0201 on 2024-10-09 19:36:59.

I have one PCIe3.0 1x slots left. I am debating putting either a 10gbps nic or nvme drive there. I can use both and strictly speaking neither are needed. I'm not sure an nvme card is even usable in a 1x slot, and I think the 10gpbs nic will be limited to 80% performance? A third option would be a sata hba and just limit myself to using at most 4 of the ports.

I'm a little unsure of the 8mbps each way of that lane given overhead of PCIe and the different protocols run over it.

The original post: /r/datahoarder by /u/HArgHorp on 2024-10-09 19:33:28.

Hello,

So I was looking at putting some YT videos on DVD to store for long-term (They’re about Silent Hill) to include in a box I have full of SH items, so in the future many years down the line I can watch the DVD to see gameplay but also documentary essay explaining the game and story because I likely won’t be able to play the game in the future or those videos could be deleted.

I was going to use Thumb Drives until I was recommended to use DVD by someone on here since they have a longer life.

I was going to use normal DVD-R, but it didn’t have enough storage and I didn’t want to use a lot of DVDS, so I started looking at DVD-R+DL because they have 4hr Storage each. I cannot find any Archival-Quality versions of DL though, only the DVD-R version.

The purpose of this is to ask what type of DVD should I use for long-term data storage in hopes I can watch these videos way long down the line? I see some DVDs can last 100+ years, but I’m unsure about how well DVD-R would be, and especially DVD-R+DL (what I want to use?) if I am supposed to use Archival Quality and not DL, then I’ll just have to split it among a lot of DVD-R Archival then.

I also heard about DVD rot but I do not know a lot about it and how it will affect me. It will be stored in DVD cases inside of a plastic storage box.

Thank you

The original post: /r/datahoarder by /u/MadEmperorYuri on 2024-10-09 22:45:50.

I have an email account with 30,000 emails. A huge quantity of it is spam. There is a huge diversity of senders, and many of them are companies from which other emails are not spam.

I'm looking for a workflow where I can search fast. I want a dedicated search interface that expects to be reused immediately (nothing modal or popup). I want to hit return and have the first screen-full of results within 4 seconds at most, and further screen-fulls cached and waiting for instant display. The emails are locally available on SSD and I have 64G RAM, so hardware is not the bottleneck.

I need to search by full email address, by domain name, by subject line, and by raw content (both text and HTML). I need to do it all with text patterns, ideally regular expressions.

I want search criteria to be remembered until I change them. I'd love to have a chronological history of previous searches I've made.

I need to select emails from among search results to mark for deletion in some way (e.g. apply a label, move to a folder). If there are multiple pages of results, I need the selection on one page not to disappear when I go to another page to select there as well. Once marked for deletion, I need for those emails to no longer appear in future searches, preferably by using remembered search criteria.

Once I've got everything marked, I need to tell a remote server by IMAP to delete the messages on its end.

Does anyone know if something already exists that does any of these things? I wouldn't be surprised if a normal email client just doesn't exist for this, since those are for everyday use cases. Are there tools for playing with email in bulk like this? Maybe ones used by data scientists or archivists? A shiny set of scripts?

I'll break out Python if I really have to, and probably have a blast with it. But really I just want to get this done.

The original post: /r/datahoarder by /u/Theman00011 on 2024-10-09 22:43:00.

The original post: /r/datahoarder by /u/-yphen on 2024-10-09 22:39:05.

I want to backup my entire drive from my main server at my house to a raspberry pi at my parents house using rsync

This is my current command that I use. I run the command on the raspberry pi, so it is pulling the data. I am using tailscale to connect everything.

sudo rsync -rvah --progress --exclude '.recycle' /home/pi/homeserver/homework/ /home/pi/backupserver/homework/

/homeserver is my server mounted to a folder with samba

/backupserver is a usb hard drive mounted on the pi

I want to preserve permissions, dates, all the metadata stuff. I basically want the electrons on my backup server to be aligned in the exact same way they are on my home server, excluding the .recycle folder.

Is this the correct way to do it, or is there a better way?

The original post: /r/datahoarder by /u/STEALT_BLADE on 2024-10-09 22:22:07.

990 of videos and files, how to sort them eficiently?

The original post: /r/datahoarder by /u/TehDwArF1028 on 2024-10-09 21:55:16.

I'm looking to make a low power/noise NAS (plus a small amount of VMs) for my homelab. To fulfil this, I'm planning on going with SSDs instead of platter drives. I also strongly prefer hot swappable drive bays. My ideal is a front drive interface similar to a Dell PowerEdge R550 or R760.

Considerations:

• Rack mountable, preferably 2U.
• Supports Mini-ITX or possibly Micro-ATX motherboards.
• Absolute minimum of 6+ 2.5" hot swap bays, preferrably with drive failure light.
• NOT using 3.5" hot swap trays with 2.5" adapters.
• Space for PCIe graphics card, prefer full size w/riser but low profile is acceptable.

I can get close to this using something like the SilverStone RM23-502 chassis with one or two 5.25" to 2.5" drive enclosure units (IcyDock ToughArmor MB998SP-B). The problem is that the product specification for the IcyDock enclosure states that the status LED only indicates "Drive Power" and "HDD Access", and not drive failure. I suspect that this feature requires the bays have integration with a RAID controller but am not familiar enough with DIY servers to know.

The original post: /r/datahoarder by /u/PresidentKan-BobDole on 2024-10-09 21:18:54.

I have a DIY media NAS running on Ubuntu Server 20.04 LTS that is primarily used for storing media and Jellyfin. It has no RAID setup and is JBOD of shucked (Western Digital) HDDs with SnapRAID+mergerfs to create drive pools and have parity for the drives. The NAS is on 24/7 and has no access to the internet (everything is just for the LAN).

SnapRAID+mergerfs Drive Pools are as follows:

1. Grand Parent Pool: Media (which entails the following subpools)
2. Subpool 1: Movies (2 HDDs + 1 HDD for parity)
3. Subpool 2: Shows (2 HDDs + 1 HDD for parity)

My questions are:

1. Are the differences between shucked external HDDs and NAS graded HDDs enough to justify specifically purchasing NAS HDDs for someone who keeps their NAS on 24/7?
2. I wish to switch to Proxmox. My goal is to have a Ubuntu Server VM to continue acting as the server OS but I want the flexibility and features of Proxmox in case I need to do something like go back to an older VM state in case anything happens with a setting or update, and to experiment with other server OSes. Would switching over be problematic with my SnapRAID+mergerfs pools (like cause data deletion or the drives to not operate properly) or would the transition be quick and painless?
3. The NAS does consume a lot of electricity. What are best practices (outside of turning off the NAS) for reducing power consumption? Would buying NAS graded HDDs help with power consumption? Or are there settings and/or software that can help with this?

The original post: /r/datahoarder by /u/Jabbuk on 2024-10-09 21:03:45.

Hello datahoarders !

I'm looking for advices. I have 2 similar HDD :

• 1 HDD with data (archives)

• 1 HDD without data

I wish to use the second disk as a security back-up in case of disk failure. My first though was to try a RAID 1 : 2 mirrored disks. But as I undestand it I would need to wipe the 1st disk. I also read Raid 1 is may be not ideal for what I want to achieve.

I don't have a NAS and I'm on Windows 11.

Do you guys have some inputs or solutions for me ?

Thanks for the help.

The original post: /r/datahoarder by /u/ButWhatIfItQueffed on 2024-10-09 20:59:51.

The original post: /r/datahoarder by /u/Kevthehustla23 on 2024-10-09 20:26:45.

I know the basics, SATA SSD and NVME SSD, etc. I know there are different form factors too, m.2, 2.5 inch, but where i dont understand is the u.2 and the enterprise level ssds. I was looking on the web and i saw someone reccommend the SSDSC2BB016T7K. I see that its just a SATA SSD 2.5 inch. What makes this enterprise?

Also, lets say i have a 500GB NVME m.2 SSD that is my main boot drive, if i want to upgrade that in the future to a larger one, what is the best practice?

Lastly, how do you guys choose your SSD's? especially if you're on a budget? is there a certain criteria you look for?

The original post: /r/datahoarder by /u/freeagent_ on 2024-10-09 19:42:44.

Hi Everyone

Today I got a new brand WD Elements External HDD 12TB ; however, the PWL (Preventative Wear Leveling) noise really annoys.

You can here the noise : www.drive.google.com/file/d/1_6Qi787j9Mk7hqGvJBePJS5HEgR8fNGz/view

Apart from the PWL noise there is a very strange noise that starts when running the hdd.

Do the Seagate big data HDDs also have the same PWL noise?

The original post: /r/datahoarder by /u/tigeed on 2024-10-09 12:32:22.

I wanted to learn more about blurays especially, for physical media preservation, but I'm new to all this and I'm having difficulty understanding the different kinds, speeds and such

I'd highly appreciate anything that could help me, YouTube videos, ebooks, websites, anything will work

The original post: /r/datahoarder by /u/StefanoDP on 2024-10-09 09:54:35.

Hi everyone! First of all, thank you in advance for your responses!

I am an editor and i’m following several projects. My workflow consists in doing a copy on a 4Tb Wd 2.5” HDD, as backup, and another on a SanDisk SSD which is the drive i’ll have plugged in to work on.

This is my idea: I was thinking on buying a 2-Bay DAS (Terramaster D2-320) and use it in RAID-1 mode. In the Bay 1 i’d mount a good 12Tb HDD and in the Bay 2, i’d mount a cheaper 12Tb HDD for a mirror backup. My idea is that when i eventually fill up the disks, i’ll remove the cheap copy and store it to keep a copy. (Considering it’ll be full of delivered and finished projects that i’d keep just for safety or portfolio reasons) Then i’ll erase the good 12Tb and mount a new cheap 12Tb as his backup.

My question is: Which HDD are best suited for this idea? I’ve heard that some Seagates are not so reliable…

And, considering that i’m working on a budget 😅, could it be a good solution? Do you have a better option?

Thank you again!

The original post: /r/datahoarder by /u/Chance-Pineapple8198 on 2024-10-09 08:32:49.

Looking at some workstation configurations for an at-home, micro-HPC setup meant for scientific computing. I’ll be working with some pretty large (potentially as large as a TB or two at a time) datasets on-workstation, and am new to RAID and this level of storage. Based on some Googling and advice elsewhere, I’m converging on a 1 TB SSD boot drive, with two, 4 TB SSD pool drives and either one, 8 TB HDD or two, 4 TB HDDs for local redundancy (NAS will provide archival and backups). Since I’ve seen some conflicting results across the web/Reddit, is it possible to run the first configuration (the two 4 TB and the one 8 TB) in a software-level (Linux OS) RAID01 with the 8 TB drive as a “single-drive” RAID0, or do I have to go with the second configuration in a RAID01 with the standard four, 4 TB drives? If I’d be willing to either up the drive sizes or add up to two additional HDDs, is there a better configuration I should consider?

The original post: /r/datahoarder by /u/DiamondDudez on 2024-10-09 07:15:17.

Hey everyone, I’m a DJ and producer, and I’m constantly dealing with huge amounts of audio files. I have lots of files in music libraries, sample packs, and my own mixes, and keeping everything organized has been a struggle. I’ve been looking for a cloud storage that makes managing large libraries easier, and I recently switched to pCloud.

One thing I’m really loving is the new audio player update—it’s made organizing my files super smooth. I can preview tracks right in the cloud without having to download them, which is saving me lots of time. I feel like this could be a good option for other musicians too. Anyone else using them? Or what cloud storage are you all using to manage your audio files?

The original post: /r/datahoarder by /u/swords_devil on 2024-10-09 05:39:34.

Hello, I have start researching NAS, my main motivation is to have access to my file from different place since I have a lot of video files and carrying a hard drive is sometimes difficult during traveling.

I am also thinking of having my phone video/photo directly back up to NAS instead of google cloud.

Since my current storage of file is already 5TB, I am looking to get a 20TB (or even 40TB but still looking at the price).

I also see people invest RAMs on this but I don't actually know why? Do people install and run games on NAS cloud so they can play anywhere?

Kind just want to see how do I dive in and if any suggestion would be awesome.

Thanks

The original post: /r/datahoarder by /u/EngineSensitive2584 on 2024-10-09 04:59:00.

Lost about 2TBs of DvDs, CDs, and just random videos I've backed up from my phone because I dropped the external drive they were on and I can't afford $450+ for recovery services.

It's not too big of a deal, most of it made it's way to my computer through Google drive downloads (which chrome will let me copy the download links and re-download), and I still have the CDs and DvDs that I ripped, so it's cheaper and easier to just re-download it all to a new drive, but it's gotten me to be aware that I should probably have more than one copy of this stuff.

I wanted to get a new external drive to put them all on (preferably not a Seagate HDD, which is what the now broken one was, because I hear they're actually SUPER fragile and not too great), and subscribe to a cloud service so that I have a digital backup that i can pull stuff from if something like this ever happens again. What are some good drives and cloud services that won't break my bank?

The original post: /r/datahoarder by /u/Holiday_Art_6218 on 2024-10-09 04:51:18.

Hey gang,

I loaded a new Synology DS1522+ with 15TB of video data via ChronoSync. I then duplicated that to another editor's drive (also via chronosync). We installed Synology Drive Client on her machine and set up a sync task. Both drives indexed, but now it's overwriting the identical files (NOT merging) on her drive. Any advice??

The original post: /r/datahoarder by /u/tenclowns on 2024-10-09 16:46:20.

Sorry for my technical illiteracy. But I either want to do remote access (which i believe will add too much lag when not in LAN) or just sync my main computer setup to the laptop if that's at all feasible. It's for music production. It could be that its enough to just sync the project files, but it might also make things easier if also the relevant software and sound libraries where also synced between the computers so that I keep the organization of everything the same. Is this possible? The most important thing would be reliability, I don't want bad syncs or corrupt files