It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
3451
 
 
The original post: /r/datahoarder by /u/g-e-walker on 2025-02-15 17:00:41.

youtube-dl-react-viewer is a web app for yt-dlp that supports viewing and downloading videos. youtube-dl-react-viewer is 100% free and open-source.

Live Demo | Screenshots | GitHub Repo

Major Changes

  • Added Return YouTube Dislike integration
  • SponsorBlock now uses K Anonymity by default
  • Made improvements to the Dockerfile to allow for easier configuration and future updates
  • Verifying file hashes, importing videos, and repairing videos can now be canceled/stopped early

The full changelog can be found on the releases page

3452
 
 
The original post: /r/datahoarder by /u/koiyama on 2025-02-15 14:12:34.

Hi,

I'm currently ripping all my 4K UHDs for easy access through a media player (and maybe an upcoming MadVR HTPC). I currently have two copies of the files:

  • one copy on two HDDs in RAID 1

  • ony copy on a third HDD as cold storage

This means I'm dedicating HDDs in a 3 to 1 ratio.

As I really do not care about uptime, I'm about to split the RAID 1 into two separate single HDDs, making it 3 copies on 3 HDDs.

One copy will be on the HDD plugged into the NAS. This will also be the one that is being accessed.

My question is whether the other two separate single HDDs should both be cold storage or should I have one of them plugged into the NAS basically on "idle".

Best regards

3453
 
 
The original post: /r/datahoarder by /u/joker_17SajaD on 2025-02-15 14:00:13.

I saw a script from 3 years ago that did something similar, but it no longer worked. So, I made my own version that downloads audiobook chapters from TokyoBook.

Check it out

If you have any suggestions or improvements, feel free to comment!

3454
 
 
The original post: /r/datahoarder by /u/rarelyactivethrow on 2025-02-15 11:18:35.

I've been using a PlusTek large-format scanner and while it's nice to scan 2 pages at a time, I'm at the point where I need to get something I can put a ton of pages in and let it do its thing. I'm trying to keep it under $500. The big snag I hit is that the one that sounded perfect says it only scans documents up to 14" long.

I don't need anything super-duper fancy or fast. Preferably a duplex scanner. Just something reliable that can do a minimum of 300 dpi. Ideally, it would also be capable of making 2 images per "page" to save me from having to manually go in and split every single image.

I saw a couple when I searched the older posts, but the ones that interested me aren't sold new anymore and I have bad luck with used electronics.

3455
 
 
The original post: /r/datahoarder by /u/IllPlankton27 on 2025-02-14 18:30:45.

Hi,

1)As part of my backup strategy, I'm using Total Commander to sync my local drive (D:\) with an external drive (E:\Backup\H), where I keep both current and deleted files. I know that Total Commander doesn't verify integrity during copying, and I want to ensure that every file in H has been copied correctly.

Since H contains both my current files and older, deleted ones, I can't just compare it to D:\ using simple checksums. Would this rclone command help?

rclone check "D:\" "E:\Backup\H" --ignore-extra --checksum

  1. My understanding is that this will only verify files that still exist in D:\, but it won’t tell me if older files in H have gone corrupt. Is there a way to verify everything, including old files?

Any advice on a better approach? Thanks!

3456
 
 
The original post: /r/datahoarder by /u/KitoLoid on 2025-02-15 10:47:59.

I had Arch Linux installed on my V-Gen Platinum SATA SSD, but I decided to wipe it and use the SSD as a normal storage drive. However, no matter what I do, the partitions keep coming back. Every tool I’ve tried says "success," but when I check again, the partitions are still there. I'm using the SSD as an external boot btw.

My Setup:

  • SSD: V-Gen Platinum (SATA)
  • OS: Dual-booting Windows & Linux Mint
  • Secure Boot: Off
  • BIOS/UEFI Mode: UEFI

What I've Tried So Far (No Success):

Windows Methods:

  • Disk Management – Tried formatting & deleting → No effect
  • Diskpart (Admin CMD)
    • clean / clean all → Permission denied
    • delete partition override → Says success, but still there
    • attributes disk clear readonly → No change

Linux Methods (Arch Live USB):

  • wipefs --all /dev/sdX → Says success, partition still there
  • dd if=/dev/zero of=/dev/sdX bs=1M count=100 → No change
  • blkdiscard /dev/sdX → No effect
  • sgdisk --zap-all /dev/sdX → Says success, but partition is still there

Other Debugging:

  • Checked for GRUB (ls /boot/efi/EFI/) → No GRUB
  • Checked if disk is read-only (lsblk -o name,ro) → Shows R:0 (not read-only)
  • Checked with Windows Disk Management → Partition is fully visible and accessible, but cannot be removed

What Could Be Happening?

  • SSD is locked in firmware write-protection?
  • Corrupt NAND flash making it read-only?
  • Windows keeping some kind of boot protection active?

I haven’t tried using an SSD manufacturer tool yet, but V-Gen doesn’t seem to have one.

What’s Left to Try?

  • Parted Magic Secure Erase?
  • Trying a different OS/Tool?
  • SSD might be dying and needs replacement?

If anyone has ideas or has faced something similar, I’d really appreciate the help.

3457
 
 
The original post: /r/datahoarder by /u/vin5556 on 2025-02-15 09:20:10.

Hi

im new to windows storage spaces but when i combined my 3x3tb + 1x1tb + 1x2tb drives and then create the pool ... i can set the pool to 32tb if i want to !!? how does that work

what i want is the amount my current drives can handle and i dont know what that amount is

Thanks

3458
 
 
The original post: /r/datahoarder by /u/Itzhiss on 2025-02-15 09:00:20.

So I recently purchased a Cenmate dual hdd enclosure ( with raid support ) it says the limit is 40tb ( 2x20 each ) and with the sizes of drives are going ( 20,22,24,28 ,etc) I can't for the life of me find out what would be stopping me from putting 2x28 drives in?

Like is it the hardware in the enclosure thats limiting it ? Or is it the data transfer from usb into my windows server ?

Sorry if this has been asked before. But I've looked around and I cannot find anything to help me ( besides me buying two 2x28tb hdds which I can't afford lol )

So I'd appreciate input of what is the limiting factor for hdd support in enclosures if you can. Thanks.

3459
 
 
The original post: /r/datahoarder by /u/octosquigglez on 2025-02-15 08:42:42.

i've been trying to download this movie off nepu.to for quite a while now because it's the only place i've seen it available in 1080p. i've been trying to use yt-dlp and the steam detector to get the m3u8 file, but every attempt ends in a ERROR: [generic] Unable to download webpage: HTTP Error 403: Forbidden (caused by <HTTPError 403: Forbidden>). i assume there's some sort of time constraint on it somehow, but since its also protected by a cloudflare anti-bot challenge you have to add another command on top which i think slows down the process . i've also tried using the file centipede extension but it also doesn't work, whenever i try to download it just says Send failed, Cannot connect to localhost:10111

i also tried using inspect element/dev tools but i think it has a dev tools detector (by calling the debugger in an endless loop or something thats just what this says but i don't think it's that far off since whenever i open inspect it says debugger paused), and when i close dev tools the page then blacks out the whole page and shows text that says "Don't open Developer Tools." and then refreshes.

honestly i'm stumped so if anyone can help me out here it would be greatly appreciated .

3460
 
 
The original post: /r/datahoarder by /u/NajdorfGrunfeld on 2025-02-15 07:47:27.

I was trying to download all the pdfs from this collection at once: https://archive.org/details/pub_mathematics-magazine?tab=collection

Couldn't find anything useful on the web other than a chrome extension that seems to have expired. I'd appreciate any help.

3461
 
 
The original post: /r/datahoarder by /u/ericlindellnyc on 2025-02-15 06:26:37.

I have a gigantic deduplicating/reorganizing job ahead of me. I had no plan over the years, and I made backups of backups and then backups of that -- proliferating exponentially.

I am using rmlint, since that seems to do the most with the least hardware. Dupeguru was not up to this.

I've had to write a script that moves deeply nested folders up to the top level so that I don't tax my software or hardware with extremely large and complex structures. This is taking a looooong time -- maybe twelve hours for a fifty GB folder.

I'm also trying to sort the data by type, and make rmlint dedup one type of data at a time -- again, to prevent CPU bottlenecks or other forms of failure.

I also have made scripts that clean filenames and folder names.

It's taking so long I'm tempted to just use rmlint now, letting it deal with deeply nested folders, but I'm afraid it might gag on the data. I'm thinking of using rmlint's merge-folders feature, but it sounds experimental, and I don't fully understand it yet.

Moral of the story -- keep current with your data organization, and have a good backup system.

I'm using 2015 iMac 27" with MacOS-Montery. 4GHz clock, 32 GB RAM.

Any pointers on how can proceed? Thanks.

3462
 
 
The original post: /r/datahoarder by /u/aastikdude7 on 2025-02-15 06:22:39.

I've noticed that others have shared archives of retro magazines, including Game Informer since game informer shut down a year or so back. However, I've stumbled upon a more extensive collection. If anyone has a more comprehensive set that includes issues from 2014 onwards, I'd love to see it. Please consider sharing or creating a torrent to help complete the collection.

Torrent Magnet :

magnet:?xt=urn:btih:68a5442a478f3bd693a2492eb49c5e8aad85991e&dn=Retromags%20Game%20Informer%20Collection%20Issues%201-260&tr=udp%3A%2F%2F185.82.216.90%3A1337%2Fannounce&tr=udp%3A%2F%2F151.80.120.112%3A2710%2Fannounce&tr=udp%3A%2F%2F62.138.0.158%3A80%2Fannounce&tr=udp%3A%2F%2F62.138.0.158%2Fannounce&tr=udp%3A%2F%2F74.82.52.209%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.internetwarriors.net%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.leechers-paradise.org%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.zer0day.to%3A1337%2Fannounce&tr=udp%3A%2F%2Finferno.demonoid.pw%3A3391%2Fannounce&tr=udp%3A%2F%2Ftracker.pirateparty.gr%3A6969%2Fannounce&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A80%2Fannounce&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A1337%2Fannounce&tr=udp%3A%2F%2Ftracker.coppersurfer.tk%3A6969%2Fannounce&tr=udp%3A%2F%2Fshadowshq.yi.org%3A6969%2Fannounce&tr=udp%3A%2F%2F9.rarbg.com%3A2710%2Fannounce&tr=udp%3A%2F%2Fwww.eddie4.nl%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker1.wasabii.com.tw%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.vanitycore.co%3A6969%2Fannounce

3463
 
 
The original post: /r/datahoarder by /u/geekman20 on 2025-02-15 04:14:33.
3464
 
 
The original post: /r/datahoarder by /u/No_Preparation_9916 on 2025-02-15 02:23:51.

Wondering if anyone else has run into this issue. All my data is there. Its just that the new OS sees it as raw/inaccessible. I guess I will back up with 10 with an external drive and make a new storage space on windows 11.

3465
 
 
The original post: /r/datahoarder by /u/grizzlypass on 2025-02-15 01:50:04.

So this is what my DAS seems to be using for its fan connector. I'm looking to replace it with your typical 3- or 4-pin PC fan, but I'm not seeing any adapters for it.

https://www.jst.com/products/crimp-style-connectors-wire-to-board-type/xh-connector/

3466
 
 
The original post: /r/datahoarder by /u/Redefinedpotato on 2025-02-15 01:46:42.

Hey all I'm a newbie to this and am looking for some advice on my next steps. I have enough computer knowledge to hurt myself and others so apologies in advance if I am mistaken with things

Back in the olden times I had a iPod classic 256 gig that I thought was Bee's knees. I would plug it into every iTunes I could get my hands on and take a whole copy of their music library to add to my collection (most people only had 16 or 32 g iPods back then so I could hold quite a few) and use my iPod as the communal device. I always thought that was really cool and it worked great for years until it finally broke; So I want to recreate it in some way.

I simply listen to a fuckton of audiobooks and wanted to keep them all after I read them. I have around 500gb~ of audiobooks in mostly .m4b that I have been storing on a Samsung Evo 1TB using my phone. I use my phone to torrent things because I can't be bothered to pay for a VPN or to get a passive aggressive letter from Comcast in my mailbox And I'll be damned if I don't use every gigabyte of my unlimited 5g plan

Unfortunately microSD are going going gone and I needed a better solution anyways. A few years ago my area was hit by a flash flood and I lost quite a bit of my old data , which sucks dick, so the redundancy of cloud storage is really appealing to me since RAID is unnecessary for something so small scale imo.

What I have been doing now is just uploading my library to Google Drive since I have the 2tb plan for free because of some promotion or other and it's been working perfectly so far. I use an app called DriveSync for Android (great app btw is simply works 100% of the time) to cycle in books to a temporary folder before I can organize them accordingly. I have another folder set up to download to my phone for the books that I want to currently read and that way I can save up space without compromising accessibility. I have my Google drive set up so this folder is separate from the rest of my stuff, only editable in every folder except the temp folder I have at the bottom for uploads and organization.

I've shared this link with a few of my coworkers who I know I can trust not do something stupid like upload a virus or something but obviously that is a concern if I ever want to make something like this more public. I also don't know exactly if this is scalable going forward without setting up some sort of server, But I'm afraid doing that will put off the not technically minded people from participating because it's scary for them to have to access something like that.

My additional thought is hoping to automate the process of adding books in some way. One of my co-workers is a fully certified coder and said it is possible to set up some sort of website scraper using an RSS feed and a healthy dose of Python or Java but that is beyond my capacity at this time (and his time to create) and probably also out of current project scope.

Anyways, I'm sorry for rambling and if this sounds stupid and unubtainable but it's been on my mind. Any tips tricks or help is greatly appreciated!

3467
 
 
The original post: /r/datahoarder by /u/kinkyloverb on 2025-02-15 01:40:10.
3468
 
 
The original post: /r/datahoarder by /u/Novel_Sheepherder_69 on 2025-02-15 00:38:06.

Hello,

I need an OS boot drive that won't break the bank - preferably 2TB. I noticed the KC300 is much cheaper than most other M.2 drives with DRAM cache (990 Pro, SN850X, T500, etc). Is there a catch? I've heard that it runs hot and throttles under load, but I intend to use the motherboard heatsink. I've also heard mention of firmware issues on the Phison E18 controller. Does anyone have experience with it?

3469
 
 
The original post: /r/datahoarder by /u/QuirkySmirkyIan on 2025-02-14 23:59:22.

Hi, I'm wondering what options I would have if I wanted to store important personal information with me. I would want it to easily fit in a backpack while not taking up much space, or even in my pocket. I hear from this Sub that flash drives are not reliable enough as an archival method. Basically, how could I store likely no more than 1TB of data in an apocalypse or hermit life scenario where I am living out of my backpack or even just backpacking around the world? Use cloud storage is not a response I'm interested in, thanks!

3470
 
 
The original post: /r/datahoarder by /u/RepressedTraas on 2025-02-14 23:55:50.

Hi everyone,

I‘m a wedding planner and am looking for a safe way to share large pic/vid files with my clients. What method have you used that you trust for keeping your files private and secure? Any tips would be great!

3471
 
 
The original post: /r/datahoarder by /u/LaundryMan2008 on 2025-02-14 23:47:56.

Today I have something I wasn’t sure I should post as the data is recorded onto VHS in a standard format that can be viewed on a standard VHS recorder/player like data cassettes are unlike the format used by Coleco Adam cassettes which ran the tapes faster and with a low level formatting but I decided to include this one as it’s unusual enough to be worthy of a post.

It is a VHS data tape which is recorded by a special cartridge attached (just a cartridge connector with a thick ribbon cable going to a metal box with 5 lights on it saying power, data, record, high speed and error (error light flashes different amounts depending on the error)) to the back of the Atari 65XE that generates a specialized video signal with DTMF audio cues to tell the encoder what point the data is at, I believe that it came with a specialized player that responded to the DTMF tones to play, stop and search through the tape but I have modified my player by attaching some wires to the tape control buttons on the front and routing them to the back to a male connector which allows the encoder to control the VCR.

There was a version released for the Atari 65xe which is the one I have but the tapes that I have were cheaper for some reason and the original owners bought the Amstrad tapes to save some money like some may have bought Macintosh formatted Zip/Jaz disks if they were cheaper, from what I could gather is that the tapes have a low level formatting stored on them that made using normal VHS tapes a no go, they also had some sort of copy protection like Macrovision which blanked the screen if you tried to duplicate a tape yourself but I defeated that and have a capture of a blank tape if I need more tapes for my Atari.

It seems to me that I am the only person with this equipment and that not even the geekiest of retro geeks have or even heard of it, I also seem to have the high speed version as it has a high speed light and the loader on the tapes starts at low speed before going to to high speed which enables the high speed light, I unfortunately have the encoder box stowed away but I do have one of these tapes and a couple of images of the tape capture (can’t show you actual data (even the low speed loader) because of GDPR data protection as I haven’t gone through and erased the data on them), the original owner of the encoder and the tapes used it at work to store large datasets from scientific tests (from seismographs and radiographs with more I can’t recall).

Thank you for reading this Friday‘s post and I hope you have a great day, if you have any queries, thoughts about the format, additional information or to point out a mistake, please put them in the comments :)

Link to previous post, post 12 (29th week): https://www.reddit.com/r/DataHoarder/comments/1ik93qg/my_data_storage_mediums_post_13_32nd_week/

I noticed a mistake within the label of my tape which I wonder if you will notice

Another view

The barcode, seems like they had over 600 tapes but they destroyed most of them and kept the really important ones which I have 50 of

Low speed header before the data, used to load the loader in before moving up to high speed loading or continuing at low speed

High speed header, it’s very brief and took me a few attempts to capture it without showing any data, this is the 2nd part of the header as the square part was too hard to capture, as you can see the data is at a higher density and is fed at a higher speed to the decoder based on the scanline passing through the data blocks

3472
 
 
The original post: /r/datahoarder by /u/QuestionsToAsk57 on 2025-02-14 22:51:31.

I had a “famous” Philly relative who had many ads on Philadelphia TV between the late 70s and the mid 90s.

I recently heard about Marion Stokes archive and I was wondering what the update on it was.

I know it is impossible to comb through 71000+ videos to try and find many ads as possible but I was wondering if the archive was still being worked on yet.

Also, what would be the best way to search the videos for the ads I’m looking for? I would give the name of the relative but I don’t want people to know.

3473
 
 
The original post: /r/datahoarder by /u/--dany-- on 2025-02-14 20:50:22.

WD's new HDMR tech to enable record-breaking 100TB+ drives | Tom's Hardware

Assuming they must be SAS-4/5 drives?

SATA-3 is 6Gbps, these drives would take about 37 hours to read at theoretical full speed. Real world reading of a full drive is likely to be a few days...

3474
 
 
The original post: /r/datahoarder by /u/Ikkoru on 2025-02-14 23:42:17.

Greetings, Masters of Data Hoarding!

I have long wanted to increase the safety of my data, but have been holding back on account of the hefty toll on my miniscule riches, and the seemingly high complexity of initial setup.

However, the time has finally come for me to gain peace of mind!

I have scoured these archives for guidance on the processes and pitfalls of Data Hoarding, and have finally decided on my setup. However, as an humble neophyte, I seek your wisdom on the matter. For I am still a fool amongst sages.

To preface this, I understand the greatness of the 3-2-1 backup strategy, however my first step will be to safeguard my data against drive failure and other types of vile, non-software-related corruption.

As such, I have decided to use a DAS, and as a wretched Windows plebeian, the StableBit DrivePool program for management, and data redundancy. For the filesystem, I will use ReFS.

I have chosen the TERRAMASTER D6-320 enclosure for future expansion, and will start with 2x Seagate IronWolf Pro (16 TB) (ST16000NE000) HDDs, and 2x old Crucial (MX200 & MX500) SSDs that I inherited from my distant ancestors. I will use the SSDs for high-read, low-write data.

After testing the DAS and disks, I will move my data, and add the HDDs I'm currently using to the drivepool (but not to the DAS).

I have a UPS, and will mostly store read-only image, music, and video collections.

There remain several mysteries, that I was unable to dispel:

  • Is there a point to using the DrivePool SSD Optimizer plug-in?
  • Is there a point to using Primocache?
  • If above are yes, do I just use one of them?
  • Is there a point to using Snapraid?

Have I forgotten anything? Are there any new programs, or techniques that haven't been mentioned in the 2+year old posts that I have read for guidance? Are my hardware/software choices cringe? Did I commit a foolish mistake somewhere? Will my cats catch on fire?

Any tips will be greatly appreciated!

3475
 
 
The original post: /r/datahoarder by /u/GC734 on 2025-02-14 22:39:23.

Hi all! I have a 1TB HDD in poor health and I want to move all files in it (about 300gb) to the new 8tb hdd. Is it ok to temporarily place it on amazon package cardboard inside the case (it’s laying on the desk atm so no vertical fall risk). After i move everything i’ll remove the 1 tb hdd from the one bracket I have and put the 8 tb new hdd on it.

view more: ‹ prev next ›