It's A Digital Disease!

The original post: /r/datahoarder by /u/ryanp1ays_ on 2024-10-05 03:45:03.

Hello!

I have a NAS that I store a bunch of movie on. I'm able to legally download movies from a website called mediasack but I'm wondering if I'm able to do something like that with TV shows. Could anyone help?

The original post: /r/datahoarder by /u/TryKey925 on 2024-10-05 02:36:13.

Been using Teracopy but it's Collision options are kind of terrible. I've seen ancient blog posts rank several other open source copy managers like 'Copy Handler' far higher - but what's the current default / best option?

My main issue is millions of tiny files like Node_modules files.

The original post: /r/datahoarder by /u/fogertlas on 2024-10-05 01:18:32.

I cloned my old ssd to a new ssd but it wouldnt boot. created a recovery media but it still did not work. Macrium successfully cloned my old disk to the new one. Or so it says. The logs even confirm that the clone was successful. But for some reason my pc cannot detect my new ssd and it shows up in disk management as having an unallocated partition. On macrium I can see the disk but it shows only two partitions with the rest being empty. Please help

logs

proof of completed clone

please why did it fail?

shows up in macrium as empty

shows up in disk management as empty

please help

The original post: /r/datahoarder by /u/radraze2kx on 2024-10-05 01:16:16.

I would just like to thank the homelab, datahoarder, and unRAID communities for the treasure trove of information.

I've finally expanded my homelab with an unRAID server, and it'll be ready for data hoarding right after this 24 hour format. I look forward to the rollercoaster we ride together in the future!

Current Homelab:

Custom Z10PE-D16 WS Tower Server:

• Form Factor: Phanteks Enthoo Pro E-ATX Tower
• Processors:
  • 2 x Intel Xeon E5-2640 v4 (10 cores each, 2.4GHz)
• Memory:
  • 256GB DDR4 (ECC) (8 x 32GB)
• Expansion Slots:
  • 4 x PCI-E 3.0 x16
  • 2 x PCI-E 3.0 x 8 (both seating 2.5Gbps NICs)
• Networking:
  • 2 x Intel 1Gbps
  • 2 x 2.5Gbps PCI-E cards
• Storage:
  • 2 x 1TB WD Blue SATA (RAID1), soon to be 2 x 4TB NVMe OS/Hyper-V VMs
  • 1 x 4TB WD Black SATA for local image backups
• Cooling:
  • 2 x Noctua NH-D15S w/ dual fans
• Power Supply:
  • PC Power & Cooling 1200W Silencer
• Rack Mounting:
  • It's just sitting on the bottom full-depth shelf of the rack
• Role: VM Host, mainly games with dedicated server capabilities, some internal servers and some automation scripts

===

Added to Homelab with the knowledge provided by the aforementioned communities:

Supermicro SuperServer 6028U-TRTP+ 12-Bay LFF 2U Rackmount:

• Form Factor: 2U Rackmount

• Drive Bays:

  • 12 x Hot-swap 3.5" drive bays
  • Optional 2 x 2.5" hot-swap SSD rear drive bays
  • Storage included: Supermicro SSD-DM032-SMCMVN1 32GB SATA DOM (removed for unRAID)
  • Storage:
    • 8 x WD DC HC550 18TBs (144TB Total)
    • 2 x Seagate Exos 18TBs (Parity 1 & Parity 2)
    • 2 x WD Blue 1TB SATA (Cache 1 & Cache 2)
    • Shout out to Josh from FB Marketplace for being a solid seller in a world of scammers. 10 x 18TB Enterprise drives, with 50-2500 Hours each, for $10/TB. You the MAN!

• Processors:

  • 2 x Intel Xeon E5-2650 V4 (12 cores each, 2.2 GHz)

• Memory:

  • 128GB DDR4 (ECC)
  • 24 DIMM slots, 8 open DIMM slots

• Expansion Slots:

  • 1 x PCI-E 3.0 x16 (Full Height, 10.5” L)
  • 6 x PCI-E 3.0 x8 (4 Full Height, 10.5” L, 1 Low Profile, 1 Internal Low Profile)

• Networking:

  • 4 x 10GBase-T ports

• Storage Controller:

  • 10 SATA3 ports by default
  • Optional support for 12 SAS3 ports

• Additional Storage:

  • Supermicro AOC-SLG3-2M2 card for 2 x M.2 drives

• Cooling:

  • 4 x Heavy-duty fans with fan speed control

• Power Supply:

  • 1000W High-Efficiency Redundant PSU (96% efficiency)

• Rack Mounting:

  • Includes Supermicro sliding rack rails (left rail does not lock properly but slides and holds well)

Role: unRAID Data storage

Shout out to Chris from OfferUp for the solid server setup minus the drives, works beautifully! And at $400, I feel like I robbed you. If you ever see this, come get fed. I owe you bigtime!

Rack: NetApp NAC-0501

Shout out to Ray and his Wife from OfferUp for selling the rack for $50 (yea, fifty bucks!) and the 24U that will soon be home for the redundancy server at my office.

Pipes: 2Gbps Up/Down Fiber, 2.5Gbps Network Equipment throughout (including in the server). Getting ~2.2Down/2Up when testing

Shout out to my Cox rep for locking me into a 2-year 2Gbps up/down with unlimited data for $100/month. You the real MVP, Suzie <3

Pics:

Gorgeous 42U rack. Future expansions will most likely be relegated to 4U Disk Array Servers... this 2U is loud enough as it is :) I will eventually replace the NetApp acrylic with a custom one but that's after my gf gets her 3D printer setup working

Tiny little shelf with the network equipment. I kinda hate Ubiquiti for not making it easier to mount their smaller equipment in a full-width rack, but this is tempory. There's a NICGIGA 2.5Gbps switch connected to a Unifi UXG-Max. The house was pre-wired for Cat5e and hasn't had any issues with transfer speeds. The Unifi 150W PoE Switch is fed by the NICGIGA. Both will be replaced with dual Unifi Flex 2.5Gbps switches once they're available for purchase again.

The full-depth rack shelf is not pictured. I also have a bunch of RGB lights I need to add to the NetApp rack because RGB adds horsepower ;)

Went with these ORICO 2.5"-to-3.5" drive adapters based on Amazon reviews

Super excited :)

144TBs of Storage, 18TB of Parity, 1TB of Cache

Adding the drives in accordance with the serials in the above sticker so I can easily locate them

Formatting the parity and storage drives.

Future Plans:

Ray and his Wife sold me a 24U rack I'm going to put at my office and I will load a second unRAID server over there which will backup all the data from this server in an identical fashion. The primary server is here at my house for the 2Gbps pipe, we could only get 300Mbps fiber at the office.

I can't wait for tomorrow. I haven't been this excited about tech since AMD released their first dual-core processors and Unreal Tournament 2004 came out ;)

The original post: /r/datahoarder by /u/vghgvbh on 2024-10-04 22:34:30.

The original post: /r/datahoarder by /u/TrainerDaasC on 2024-10-04 20:39:14.

I have a huge dvd collection and I would love to just save all that content to my hard drive instead of re-watching everything one disc at a time.

For non-copyrighted discs it's super easy for me to just copy/paste the audio/video folders, but I'm struggling with everything else that's copy protected. I don't want to record the content by ripping, I just simply want to copy/paste as it seems the best way to get the menus as well as bonus features. Thanks in advance for any advice or help on this!

The original post: /r/datahoarder by /u/shumandoodah on 2024-10-04 20:03:33.

Has anyone seen a clean "bundle" of all the Sesame Street shows? Specifically looking for ones up to the mid 80's.

The original post: /r/datahoarder by /u/sunnysideup_down on 2024-10-04 19:54:05.

Wanting to download some courses on a website, video links are easily detectable using Firefox or chrome extensions and I have an account on the website.

How would I go about downloading the videos automatically?

The original post: /r/datahoarder by /u/dingo4ever on 2024-10-04 18:43:46.

TLDR: Seagate sent me a dead drive to replace a dead drive and now all I get is a run around from support of you need to give us a proof of purchase.

Recently had two drives in my NAS start throwing errors ( 6tb exos drives bought new less than 2 years ago running in a qnap nas) not a big problem, sucks for enterprise level drives to be going bad that early but hey that's life right. contact Seagate support and pay for replacements to be sent under warranty. Replace first drive, great.... Start the rebuild for the second drive and the first drive fails, spectacularly. Oh and now I've lost everything on the server. But like a good data horder I have backup of the backup, but still this means dozens of hours of my life gone since I'll need to rebuild.

Getting the original replacement drives from Seagate was a cake walk under warranty, but now that I'm trying to get the bad drive they sent me as a warranty replacement replaced..... All they keep saying is they have no record of that drive serial number being sold and I need to provide a proof of purchase for the drive to continue. I have quite literally explained that providing a Proof is impossible since that drive is not purchased 6+ times but I'm just going in circles. I try and talk to support but get told my case is escalated and that I need to provide proof of purchase. Honestly I want to wash my hands of Seagate entirely from this nightmare. Does anyone have any suggestions? I'm at my wits end, I can't even rebuild the server until I get the drive. Do I just cut my losses and buy new? If so do I ditch Seagate and go to WD enterprise instead?

The original post: /r/datahoarder by /u/repawel on 2024-10-04 18:12:17.

I've released a new version of cryptreboot, an MIT-licensed, drop-in reboot replacement for disk-encrypted Linux systems.

The tool prompts for the passphrase before reboot, while the system is still fully operational and remotely accessible. This contrasts with a standard reboot, where the passphrase must be entered during early system initialization, often without network access.

This version adds support for native ZFS encryption with a LUKS keystore (as implemented in Ubuntu) and continues to support classic, plain-LUKS encryption.

No configuration is required—simply install the tool and use "cryptreboot" instead of "reboot." It also integrates smoothly with Dropbear-enabled initramfs configurations, allowing cryptreboot to function as usual. For standard reboots or system power-ons, the disk can be unlocked remotely via SSH.

To install on Ubuntu:

sudo apt install ruby kexec-tools
sudo gem install crypt_reboot

For more information, visit the project homepage and GitHub repository:

https://phantomno.de/cryptreboot

https://github.com/phantom-node/cryptreboot

I've seen many LUKS-related topics on this subreddit. I hope cryptreboot will be useful to data hoarders using disk encryption. If you have any questions or feedback, I'd be happy to address them here.

EDIT: I made a mistake in the post title. Of course, 0.3.1, not ~~3.0.1~~ is the the newly released version.

The original post: /r/datahoarder by /u/wblondel on 2024-10-04 17:38:35.

The original post: /r/datahoarder by /u/TheIllusioneer on 2024-10-04 17:16:58.

We were being teased about them early last year. I check for any news every few weeks but it's been quiet since that announcement. Any news? release dates?

The original post: /r/datahoarder by /u/Duck_Dur on 2024-10-04 16:41:51.

Hello Data Hoarders,

I am fairly new to this community and I am upgrading a drive at the minute from 1TB drive to 10TB. How would I go about transferring data from the 1TB drive to the 10TB. All my life is stored on this drive and I would hate to loose it (yes, I am running RAID-1). Would I need some software or something like that?

The original post: /r/datahoarder by /u/wertyegg on 2024-10-04 16:34:36.

The original post: /r/datahoarder by /u/TheInfamousDrD on 2024-10-04 15:03:32.

I have a new 4 disk RAID enclosure. I have 4 new identical 4TB WD drives in it. I've set it up in several different ways including just "Single" so no RAID even.

My PC sees the drives, but both Windows and Linux fail to initialize the disks. No useful errors. It looks like my enclosure is bad unless there's some trick I'm missing.

The original post: /r/datahoarder by /u/AshleyUncia on 2024-10-04 14:44:22.

The original post: /r/datahoarder by /u/imaginary-fireplace on 2024-10-04 13:30:30.

Planning to buy a mac mini and supplement the storage with an external enclosure. Usage is mainly as a device to store photos/videos or work from when editing vacation videos.

What advice would you have for SSD enclosure + SSD combo?

I feel like the Acasis thunderbolt might be too overkill for my needs? But it does open up space for upgrades.

I’ve looked into the Sabrent EC-SNVE as well

The original post: /r/datahoarder by /u/hiesebergg on 2024-10-04 13:22:55.

What's the difference between a WD My Book and Seagate one touch ? I can buy the 4tb version of either of them for almost the same price. Which one should i go for ?

The original post: /r/datahoarder by /u/didyousayboop on 2024-10-04 13:00:34.

Starting very soon, the back catalogs of all The New York Times' podcasts (e.g. The Daily, The Headlines, The Interview, Modern Love, The Ezra Klein Show, Hard Fork) will go behind a paywall. New episodes will continue to be free. (More information here.)

Here's a very simple step-by-step guide to archiving these podcasts that anyone can easily follow.

Step 1. Search on archive.org to see if the podcast has already been saved there.

Step 2. Find the podcast’s RSS feed on podcastindex.org.

Step 3. On Windows, paste the podcast’s RSS feed into the free, open source app Podcast Bulk Downloader: https://github.com/cnovel/PodcastBulkDownloader/releases (There may be an issue with Windows Defender or other antiviruses mistakenly flagging the .exe files as malware. Chrome and Firefox's built-in malware detection may do the same.)

For Mac and Linux (or if the previous option doesn't work on Windows) you can use gPodder: https://gpodder.github.io It’s also free and open source.

Step 4. In Podcast Bulk Downloader, select “Date prefix”. This puts the episode release date in YYYY-MM-DD format at the beginning of the file name, which is important if someone wants to listen to the episodes in chronological order. Then hit “Download”.

In gPodder, go to Preferences → Extensions → check “Rename episodes after download” → Click “Edit config” → Check “extensions.rename_download.add_sortdate”.

Step 5. Create an account on archive.org with an email address you don’t care about. It’s bewildering, but your email address is publicly revealed when you upload any file to archive.org and they do not ever warn you about this. Firefox Relay is a good tool for this: https://relay.firefox.com

Step 6. Fill out the metadata fields on archive.org, such as title, creator, description, and subject tags (e.g. “podcast”). I recommend including a jpeg or png file (jpeg displays better) of the podcast’s logo or album art in your upload. Whatever image you upload will automatically become the thumbnail. After that, go ahead and upload.

That’s it! You’re done!

Everyone has my explicit permission to copy/paste, republish, and modify this guide however they like. Please share awareness of these tools.

The original post: /r/datahoarder by /u/bitAndy on 2024-10-04 12:41:02.

I had a Seagate 8TB external HDD, and it was getting full so got another. They look identical and I've had them sitting side by side most of the evening. I was using my MacBook and realised I had to format the new drive to exFAT and so being extremely careless and overzealous to use my new drive I forgot check that I definitely had the correct drive in before formatting...

I am extremely fortunate that I have things backed up on various drives, especially sentimental things like old family videos.

I have lost some stuff though. The biggest thing being 2TB+ worth of PS3 & 360 ROMs. That was an unbearable process to collect and organise so I'm not looking forward to doing it again.

So yeah, I'm normally pretty good with my data but this was a big slip up. Moral of the story is be careful & back up your data on multiple drives.

The original post: /r/datahoarder by /u/AstronautPale4588 on 2024-10-04 12:11:12.

Hello all, when I was young I used to play a flash game called captain forever and I'd like to know if it's possible to locally download flash games as I'd like to back it up on my hard drives. I know sites like Flashpoint exist to preserve them and captain forever is on there but to my knowledge can't be backed up locally

The original post: /r/datahoarder by /u/SlicedMangoes on 2024-10-04 10:14:25.

Is this a sign of a dying SSD? I've had this SSD for about a year now slotted into the heatsink of my Motherboard (ROG B550-F WIFI). Yesterday, i noticed there was a disk write error on my steam games. The drive was undetected, and suddenly after a restart it magically appeared and worked normally.

What do i do to troubleshoot this issue?

The original post: /r/datahoarder by /u/domanpanda on 2024-10-04 10:09:15.

On my laptop i have 2TB nvme from which 1.1TB is taken by VMs. Those VMs come and go - they are not super important. I want to move them somewhere to external storage.

The easiest way would be to just buy new nvme disk and slap it into my IcyDock nvme enclosure. But i have bunch of old 2.5" SSDs lying in my shelf - 4x120, 2x250, 2x512GB. As i said im not afraid about VMs data so i think those would be good enough. I wonder if can make some storage pool from them. If so how? Also have 2x1TB HDDs 2.5" which was my old ZFS pool but these will probably be too slow for VMs.

NAS will be expensive and slow (1gbps is not enough).

Buy few usb disk enclosures + usb HUB, connect it to laptop and make mergefs/LVM pool?

Buy some JBOD enclosure like thos yottamaster, (but this in terms of price may come close to new drive)?

Any other ideas?

The original post: /r/datahoarder by /u/ZOMGsheikh on 2024-10-04 09:34:17.

I have a Synology HAT 5300 - 16Tb that i bought used. It is currently being used in a windows PC and not a NAS. Drive checks all positive boxes and no errors on regular use. But I have noticed, whenever my PC wakes up from sleep and if I try to access the drive in file explorer, any folder I click inside the drive, throws THIS MESSAGE.

It's the same if I dual boot in a Linux system. If it wakes up from sleep, it just doesn't open any folders. Over there I can at least quickly unmount and mount it to make it work but in windows only a restart fixes the issue. Any idea what could be affecting the hard drive?

The original post: /r/datahoarder by /u/BronnOP on 2024-10-04 08:37:41.

The BBC “Addicted to Games” documentary aired in December 2010 and doesn’t seem to be available on their website or iPlayer anymore.

A few copies are available on YouTube but they are terrible quality. Does anyone happen to have it?