It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
1951
 
 
The original post: /r/datahoarder by /u/itsthewolfe on 2025-04-18 10:25:33.

I'm torn between the two. It will be used for 4K Plex streams mostly.

Edit: DS1522+

1952
 
 
The original post: /r/datahoarder by /u/Von_Dudemeister on 2025-04-18 10:20:53.
1953
 
 
The original post: /r/datahoarder by /u/Artistic-Arrival-873 on 2025-04-18 09:35:53.

Does anyone have experience using oracle cloud for backing up photos? At $2.60 per TB it looks ok

1954
 
 
The original post: /r/datahoarder by /u/KindImpression5651 on 2025-04-18 06:48:11.

Stuff like blogs (and social media) and even stores nowadays have replaced pages (infinite sadness) with infinite scrolling.

but we all know what happens with infinite scrolling: eventually it stops working.

is there some software that can 'capture' the requests made by the scrolling so that it can try to repeat from the point the page got stuck loading, or is this impossible because of how it works on the backend of websites? (so that then you can select the text and images and download it with downthemall or jdownloader or whatever else)

1955
1956
 
 
The original post: /r/datahoarder by /u/T0biasCZE on 2025-04-18 05:36:38.
1957
 
 
The original post: /r/datahoarder by /u/Viktorvanyaharg on 2025-04-18 04:07:45.
1958
 
 
The original post: /r/datahoarder by /u/danielt2k8 on 2025-04-18 03:46:26.

Original Title: Me

1959
 
 
The original post: /r/datahoarder by /u/NeatSuspicious655 on 2025-04-18 03:12:42.

I have about 10tb of external seagate drives (5 2tb drives) of photos from over the years. All Hardrives none are ssds. ( I have a few Samsung ssd that I use for travel and as temp storage)

Currently, each of the 5 drives are cloned onto a second drive as backup. (10 total) These are stored together and I often feel like I need a better archival backup system in place for fire or flood rather than just drive failure. I'd like to store a third backup of files I'm no longer frequently accessing at my parents house out state.

What's the best solution for this? A tower drive that I can just put everything into one? Or People have suggested RAID to me but I actually have no idea what that really is.

Cloud storage is just not cost effective for me right now.

1960
 
 
The original post: /r/datahoarder by /u/PapaCrazy424 on 2025-04-18 01:10:52.

My motherboard only has 4 SATA ports and I'm trying to decide between a PCIe expansion card or m2 to SATA adapter. The ability to hot-swap drives is important. I have a bunch of old ones sitting around and I'd like to avoid system restarts to access them. Sometimes I'm not even sure which file is on what drive, and trying to reduce the annoyance factor hunting for them. Anyone have experience with these cards/adapters, or can suggest a solution? Thanks for any guidance.

1961
 
 
The original post: /r/datahoarder by /u/hyenadude7 on 2025-04-18 00:23:10.

A friend from Russia told me (and racomended me this subreddit)if I want a bunch of cheap storage I should just hunt for DVR because they usually hold hard drives I did find a few in my city but they are way to thin to have a hard drive in is there a way to spot them ?

1962
 
 
The original post: /r/datahoarder by /u/dca_user on 2025-04-17 23:15:46.

From someone who works at the National Park Service/Department of Interior in DC, posted this on Facebook:

Friends and neighbors, sadly the National Park Service is having to consolidate their library collections in HQ and are giving books and journals away. They are offering them to DOI employees, but we can't save all of them. Would anyone here 1) help identify organizations that could take what is left 2) help me transport them out of DC tomorrow? History, historic preservation, science, architecture, archaeology, etc Example included here.

https://www.facebook.com/groups/1191135197618750?multi_permalinks=9580412915357561&hoisted_section_header_type=recently_seen

I thought ya'll would be the best folks to help - or let those in DC know!

1963
 
 
The original post: /r/datahoarder by /u/CassieWTFordham on 2025-04-17 23:07:33.

I can't keep my old computer, because theres no space for it in the room where I'm moving to, and it's all going to shit anyway.

Since refurbished SAS drives cost like a $100 less than refurbished SATA drives I wanted to put together a reasonably powered SFF computer with A cheap SAS controller at least 16TB of storage plus Backup or redundancy for my video library, and 1TB plus backup for my main disk.

Or I could build a really cheap NAS that takes SAS drives, and buy a cheap minipc to use for my desktop if that could be done cheaper

I want to try to do everything for around $500 USD, but i know that's a stretch.

The only reason I want to use SAS is that the drives are cheaper, if there is a cheaper SATA solution I'd go with that.

Plus since I'll have everything in my room. Would WD drives be alot quieter than Seagate?

Just for reference, my old system had:

GA-x79-ud5 motherboard

32GB DDR ecc RAM

2x 1tb crucual mx500 ssd ( both dead now)

4x refurbished Ultrastar He6 6TB - HUS726060ALA640 (1 dead, 3 loud as fuck)

AMD RX 580 graphic card

What will give me the best bang for my buck?

1964
 
 
The original post: /r/datahoarder by /u/Harisfromcyber on 2025-04-17 23:07:24.

Recently, I went down the "bit rot" rabbit hole. I understand that everybody has their own "threat model" for bit rot, and I am not trying to swing you in one way or another.

I was highly inspired by u/laktakk 's chkbit: https://github.com/laktak/chkbit. It truly is a great project from my testing. Regardless, I wanted to try to tackle the same problem while trying to improve my Bash skills. I'll try my best to explain the differences between mine and their code (although holistically, their code is much more robust and better :) ):

  • chkbit offers way more options for what to do with your data, like: fuse and util.
  • chkbit also offers another method for storing the data: split. Split essentially puts a database in each folder recursively, allowing you to move a folder, and the "database" for that folder stays intact. My code works off of the "atom" mode from chkbit - one single file that holds information on all the files.
  • chkbit is written in Go, and this code is in Bash (mine will be slower)
  • chkbit outputs in JSON, while mine uses CSV (JSON is more robust for information storage).
  • My code allows for more hashing algorithms, allowing you to customize the output to your liking. All you have to do is go to line #20 and replace hash_algorithm=sha256sum with any other hash sum program: md5sum, sha512sum, b3sum
  • With my code, you can output the database file anywhere on the system. With chkbit, you are currently limited to the current working directory (at least to my knowledge).

So why use my code?

  • If you are more familiar with Bash and would like to modify it to incorporate it in your backup playbook, this would be a good solution.
  • If you would like to BYOH (bring your own hash sum function) to the party. CAVEAT: the hash output must be in hash filename format for the whole script to work properly.
  • My code is passive. It does not modify any of your files or any attributes, like cshatag would.

The code is located at: https://codeberg.org/Harisfromcyber/Media/src/branch/main/checksumbits.

If you end up testing it out, please feel free to let me know about any bugs. I have thoroughly tested it on my side.

There are other good projects in this realm as well, if you wanted to check those out as well (in case mine or chkbit don't suit your use case):

Just wanted to share something that I felt was helpful to the datahoarding community. I plan to use both chkbit and my own code (just for redundancy). I hope it can be of some help to some of you as well!

  • Haris
1965
 
 
The original post: /r/datahoarder by /u/Segiterio on 2025-04-17 21:43:23.

Hey Reddit! I recently figured out how to download password-protected videos from Vimeo and merge the audio and video into one MP4 file. It took some trial and error, but I got it working smoothly on Windows, and I want to share a dead-simple step-by-step guide for anyone else trying to do this. This also covers downloading multiple videos at once and making sure the audio and video don’t end up in separate files. Let’s dive in!

What You’ll Need

  • A Windows PC (this guide is Windows-focused, but the tools work on Mac/Linux too).
  • The Vimeo video link(s) and password.
  • A Command Prompt (CMD) to run commands.
  • Two free tools: yt-dlp and FFmpeg.

Step-by-Step Guide

  1. Install yt-dlp =================

yt-dlp is the tool that downloads videos from Vimeo (and tons of other sites).

  • Go to the yt-dlp GitHub releases page.
  • Download the latest yt-dlp.exe (look for something like yt-dlp.exe under the latest release).
  • Save it to a folder, like C:\ytdlp. Make it easy to find!
  • To make things simple, open Command Prompt (press Win + R, type cmd, hit Enter) and check if yt-dlp works:If it says “command not found,” move yt-dlp.exe to C:\Windows or add C:\ytdlp to your PATH (Google “add to PATH Windows” if you need help).yt-dlp --version
  1. Install FFmpeg =================

FFmpeg is what merges the video and audio into one file. Vimeo often splits them, and without FFmpeg, you’ll get two files (one video, one audio).

  • Go to gyan.dev and download the latest “release” ZIP (e.g., ffmpeg-release-essentials.zip).
  • Extract it to a folder, like C:\ffmpeg. You’ll see a bin folder inside with ffmpeg.exe.
  • To make sure FFmpeg works, open CMD and run:If it doesn’t work, add C:\ffmpeg\bin to your PATH:ffmpeg -version
    • Search for “environment variables” in Windows, click “Edit the system environment variables.”
    • Find Path in “System variables,” click “Edit,” add C:\ffmpeg\bin, and click OK.
    • Open a new CMD and try ffmpeg -version again.
  1. Download a Single Vimeo Video ================================

Here’s the command to download one password-protected video with audio and video merged into one MP4:

yt-dlp --video-password YOUR_PASSWORD -f "bestvideo+bestaudio/best" --merge-output-format mp4 --ffmpeg-location C:\ffmpeg\bin\ffmpeg.exe YOUR_VIMEO_LINK

  • Replace YOUR_PASSWORD with the video’s password.
  • Replace YOUR_VIMEO_LINK with the video’s URL (e.g., https://vimeo.com/123456789).
  • Make sure C:\ffmpeg\bin\ffmpeg.exe matches where you put FFmpeg. If you extracted it somewhere else, update the path.

Run this in CMD, and it’ll download the video as a single MP4 with audio and video together!

  1. Download Multiple Vimeo Videos (Bulk Links) ==============================================

Want to download a bunch of videos at once? Just paste all the links in one command, separated by spaces:

yt-dlp --video-password YOUR_PASSWORD -f "bestvideo+bestaudio/best" --merge-output-format mp4 --ffmpeg-location C:\ffmpeg\bin\ffmpeg.exe LINK1 LINK2 LINK3 LINK4

  • Replace YOUR_PASSWORD with the password (it works for all videos if they use the same one).
  • Replace LINK1 LINK2 LINK3 LINK4 with your Vimeo URLs (e.g., https://vimeo.com/123456789 https://vimeo.com/987654321).
  • You can add as many links as you want, just separate them with spaces.

This will download all videos one by one, each as a single MP4.

  1. Why Specify FFmpeg Path? ===========================

Sometimes yt-dlp can’t find FFmpeg, even if it’s in your PATH. Adding --ffmpeg-location C:\ffmpeg\bin\ffmpeg.exe tells yt-dlp exactly where FFmpeg is, ensuring it merges the audio and video. Without this, you might get separate files (one video, one audio), which is super annoying.

  1. Troubleshooting ==================
  • Separate video/audio files? Double-check that FFmpeg is installed and the --ffmpeg-location path is correct. Run ffmpeg -version to confirm FFmpeg works.
  • Error: “FFmpeg not found”? Make sure C:\ffmpeg\bin\ffmpeg.exe exists and the path in the command matches.
  • Wrong password? Vimeo will say “access denied” if the password is wrong. Double-check it.
  • Still not merging? Try checking the video’s formats:Look for a format like http-1080p (which has both video and audio). Then use -f http-1080p instead of -f "bestvideo+bestaudio/best".yt-dlp --video-password YOUR_PASSWORD -F YOUR_VIMEO_LINK

Final Tips

  • Keep yt-dlp updated (yt-dlp --update) because Vimeo changes stuff sometimes.
  • Save your commands in a .bat file if you’re downloading the same videos often. Just paste the command into Notepad, save it as download.bat, and double-click to run.
  • If you’re on Mac or Linux, the steps are similar, but use Terminal and adjust paths (e.g., /usr/local/bin/ffmpeg).

Hope this helps! Let me know in the comments if you run into issues or need clarification. Happy downloading! 🎥

1966
 
 
The original post: /r/datahoarder by /u/FeeDue435 on 2025-04-17 20:46:44.

I can't seem to find an Epson v600 to buy online. There are refurbished models, but new models are out of stock everywhere. What are some good alternatives? Does Epson have a newer, comparable model? Our organization needs a scanner for archiving some old photos.

1967
 
 
The original post: /r/datahoarder by /u/Constant-Mood-1601 on 2025-04-17 20:45:22.

I have a MacBook with a busted screen but it I’m able to still use it as a hard drive essentially. I can’t remember what the mode is called.

I want to transfer all my files onto some hard drives, split between at least two categories: photo/video, and music.

It sounds like NVME’s with an enclosure are all the rage right now. Would it be advisable to get 2 enclosures, and would it be possible to have 2 redundant drives in each enclosure?

1968
 
 
The original post: /r/datahoarder by /u/TGOEE on 2025-04-17 20:10:37.

We've all known this far that YouTube has been allowing music artists and publishers to re-upload a remastered version of a music video on the same video: this is, on the same link and same likes/views/comments/metadata, etc. We also all know some of these remasters are just AI or other tools upscaling of video (Camcorders, Betamax, TV cameras) recordings, which look awful in some cases and I'd really prefer to watch the original quality ones, for enjoyment reasons and, obviously, for archiving reasons. So:

  1. Is there any way to recover these original quality music videos? A: Most probably not. If you know any other answer, please reply.
  2. Anyone tried or achieved a full archive of these original quality music videos before the replacement? A: Less probably not, so if someone was able to archive some and is willing to share some (I also archived some back in 2016!), you can DM me if you're interested and we can do a mixed share of them.
  3. How to recover some of those music videos? A: Most probably, trying to rip them from DVDs music video compilations released by the same artists. These DVDs don't have YouTube's compression on the videos, so might be the best source to get them. Needless to say, not every artist is major enough or even had the opportunity to release their music videos on DVD (some of them just aired on TV), and even if so, finding a YouTube video is way easier than finding a DVD. Secondly, might just try luck on trackers that focus on music videos.

Have I replied all of the questions by myself? Yes, but also no. If you know any alternative replies to this, please share them. I know this post most probably is in the best interest of the archiving and data hoarding community. Also, if you want to discuss the replacement/removal of these original quality music videos, do so. I have searched on the subreddit and just found praise for this YouTube decision, which I find boggling coming from this sub.

Also, thanks for having me here, data hoarding is my passion and I'm really an aficionado so I love to learn reading this subreddit. Lastly, forgive me for incoherent english grammar if there's any, I'm not a native english speaker and my english skills are decreasing day after day.

1969
 
 
The original post: /r/datahoarder by /u/Various_Formal_8359 on 2025-04-16 06:10:21.

Long story short — I lost some critical Telegram chats a while ago. No export, no backups, nothing. It sucked.

That experience led to building TGDefend — a clean way to back up and restore Telegram chats securely (yes, media too). It’s encrypted, user-friendly, and actually gives you control over your data.

Would love input from fellow hoarders:

  • Would you use a tool like this?
  • What formats do you prefer for backups (JSON, HTML, PDF)?
  • Is secure encrypted cloud vs local storage a deal-breaker?

Not spamming, genuinely here to learn what backup nerds want?

1970
 
 
The original post: /r/datahoarder by /u/FondantIcy8185 on 2025-04-16 05:28:55.

SO. Many years ago I RAIDed my PC. First with (ugg I hate to say it) Port Multiplier(s).

Then a hardware RAID card

NOW.

ZFS. Still need a SAS-SATA Card. I have had this issue before, 3rd HDD "degrades". Replace HDD, scrub, attempt to repair damaged files.

Now I have a 8x PCIe SAS-SATA Card. 2 Ports. I have a Micro Gigabyte Motherboard, so this SAS-Sata card sits in the x16 (graphics) slot. To attempt to find and fix this degrade problem I have done the following

Swapped Cables in SAS-Sata Ports, scrub, swapped degraded hdd, scrub.

Plug HDD to MB and physically run HDD diagnostics. All pass

Swapped Power Cables. Swapped Power Supply PORTS.

Swapped SAS-Sata Cables. Purchased new cables and used them

Purchased new different model SAS-Sata PCIe Card, Swapped Card

Re-swapped SAS-Sata Cables & Power Cables

I've even purchased 8 new HDD's and copied (or moved) data over.

Problem always appears weeks to months later, as the 2nd Port (Port 1) on the SAS-Sata card and ALWAYS the 3rd HDD is Degraded.

I've lost my Dads (RIP) 90th Birthday Video as it was damaged and unrepairable. I have lost countless other files.

Can someone with Linux OS, and ZFS or zpool, please offer me an explanation on what is going on.

TIA

1971
 
 
The original post: /r/datahoarder by /u/Beast_Operations520 on 2025-04-17 18:28:01.

Hey guys, I've been trying to deploy my old mac mini as a home server and connected to a 4-bay drive enclosure. I know there is hardly software raid solution for MacOS, so just wonder if i can run a linux VM (via UTM, for example) to use mdadm for creating and managing RAID 5. Anyone tried that before? Any advice is much appreciated!

1972
 
 
The original post: /r/datahoarder by /u/OrneryWhelpfruit on 2025-04-17 18:21:44.

Bought my first recertified drive

Per the backblaze data, one of the SMART attributes that's supposed to predict failure is

I have

BC 100 _99 __0 000100010001 Command Timeout

Current, Worst, Threshold, Raw. The backblaze data says any value above 0 for raw corresponds to drive failures unless I'm misunderstanding?

1973
 
 
The original post: /r/datahoarder by /u/i_am_the_koi on 2025-04-17 17:33:50.

Bought a DS120j when my BiL passed away because I wanted to back up his DVD and cd collection as well as my own and not have bookshelves filled taking up space.

We barely made a dent in the 4tb and it worked fine for what we used it for.

Had twins and decided to add Disney, sesame Street and other stuff. Realizing I could save even more on streaming it's now full and I'm still wanting to add more stuff as it is handy.

Thought I'd ask all the real hoarders how to upgrade my system and ask questions.

So the ds120j is a single bay unit with a drive inside.

If I bought a 2bay Synology unit that comes with one drive, and just pulled the drive out of what I currently have and swapped it, would that work? Or is it better to buy another single bay unit and connect them together somehow?

Is the Synology system and interface in the drive Bay or the drive itself?

I've never been able to get Plex to work with my drive, both my Samsung TVs recognize it on my network for access but would it be better to figure that out? I've looked at off-site access and it seems i need my own Internet certificates and to actually know what I'm doing... Am I missing something about how easy it really is or is a Synology quirk that's a pain and I should have bought something else?

When should I worry about redundancy?

Appreciate your advice and knowledge.

1974
 
 
The original post: /r/datahoarder by /u/invincible2727 on 2025-04-17 16:45:10.

I've been reading about people who have had hard drives corrupt randomly and they lose everything. They also get told that they should have backed it up. What do they mean by that? Back it up where? Do they mean you should buy ANOTHER hard drive and just copy the data on there? I just want to buy a 4TB external hard drive so I can rip Blu Rays onto it, so should I buy two of them and download everything onto there twice?

1975
 
 
The original post: /r/datahoarder by /u/preetam960 on 2025-04-17 16:34:05.

Hey folks,

I recently built a tool to download and archive Telegram channels. The goal was simple: I wanted a way to bulk download media (videos, photos, docs, audio, stickers) from multiple channels and save everything locally in an organized way.

Since I originally built this for myself, I thought—why not release it publicly? Others might find it handy too.

It supports exporting entire channels into clean, browsable HTML files. You can filter by media type, and the downloads happen in parallel to save time.

It’s a standalone Windows app, built using Python (Flet for the UI, Telethon for Telegram API). Works without installing anything complicated—just launch and go. May release CLI, android and Mac versions in future if needed.

Sharing it here because I figured folks in this sub might appreciate it: 👉 https://tgloader.preetam.org/

Still improving it—open to suggestions, bug reports, and feature requests.

#TelegramArchiving #DataHoarding #TelegramDownloader #PythonTools #BulkDownloader #WindowsApp #LocalBackups

view more: ‹ prev next ›