It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
3101
 
 
The original post: /r/datahoarder by /u/shitty_millennial on 2025-02-25 20:55:03.
3102
 
 
The original post: /r/datahoarder by /u/mohame1118 on 2025-02-25 20:48:20.

https://preview.redd.it/mtmtv0rvkcle1.png?width=1510&format=png&auto=webp&s=3ad901e980f9427185ebb0f8cda48027b1b28e1c

In the last two days, my drive’s health dropped from 52 (which had been stable for over a year) to 49, and I’m worried it might keep declining until it eventually fails.

The bad sectors haven’t increased, only pending sectors have.

I bought a power SATA extender a month ago could that be causing the issue?

And if I unplug it and only use it when I need the data, could that help extend its lifespan?

3103
 
 
The original post: /r/datahoarder by /u/kitkatsarts on 2025-02-25 20:16:50.

Hello! I have decided to at least start informing myself more on the complexities of running a home data server. I already have a server which I picked up for free to run a minecraft server (which I've been doing for years) but it's an old hunk of junk. I decided to look into its specs and it has 4sata ports, 2 pci-e 16x connectors, and 1 pci-e 1x connector.

Now, as I'm a total noob I've no clue what any of this means. Is this any good? And can I use whatever cheap dated drives I can find? It'd mainly serve as a backup because I don't trust my laptop to safely hold everything. (It's a lump of trash holding on by a thread). I've got a pile of old 160gb and 500gb HDDs laying around and was wondering if these would work as a first attempt. Any tips and advice is dearly welcome.

3104
 
 
The original post: /r/datahoarder by /u/SHUVA_META on 2025-02-25 19:35:55.

I want to buy an HDD in which I can backup my music, movies, downloaded videos and other stuff. Which HDD is reliable and cheap for my usage.

3105
 
 
The original post: /r/datahoarder by /u/scoliadubia on 2025-02-25 19:07:44.

I have three different tools that can save TikTok videos from an account en masse. However, all at least partially three fail with accounts with 5+ years of history and multi-thousands of videos. One fails completely. Two others successfully download the latest 900 or so videos from that single account but act as if the older ones don't exist.

Has anyone successfully backed up a large public tiktok account? If so what did you use to do it? Or was there some magic tiktok URL you could use to see only videos from a particular year or some other way of flitering?

3106
 
 
The original post: /r/datahoarder by /u/angelomarzolla on 2025-02-25 17:45:57.

I'm going to buy new hard-drives to my PROMISE PEGASUS2 R8 unit. I found some documentation on the manufacturer website but it is not clear if those units will work with HDs bigger than 6TB (each).

https://www.promiseworks.com/datasheets/Pegasus2_DS.pdf

https://www.promise.com/DownloadFile.aspx?DownloadFileUID=6600

Anyone have some experience with that?

Thanks!

3107
 
 
The original post: /r/datahoarder by /u/mejillonius on 2025-02-25 16:51:32.

Excuse me if this isn't the subreddit to ask.

A friend of mine gave me a couple HDDs and i thought that it would be cool and practical to make my own cloud since you can't hoard much without paying dropbox a small fortune and the numbers add up. But other than i need a NAS for that i have no idea where to start.

I have only 2 +1 requisites

  1. multiple users, since it is for family and friends

  2. simple to configure and accesible from outside my local network

  3. on pc i should be able to have an autosync folder like dropbox does (this one is important)

any info will be appreciated.

thanks

3108
 
 
The original post: /r/datahoarder by /u/Sfoil85 on 2025-02-25 15:26:06.

So I've been having teracopy having issues for awhile now...what is weird though is that I don't get a single error code. Two issues overall.

  1. After a random amount of time(sometimes 30 minutes, sometimes 4 hours in) teracopy just pauses transferring. It literally just hangs on a file, no error and not technically paused or anything, its like it just froze. I can still press buttons but for instance pressing stop won't actually do anything. I have to always restart the maching to be able to continue.

  2. I get this image sometimes with these red arrows. I checked on teracopys site for tech support and every other image is shown with a description, except this red arrow.

https://preview.redd.it/d3g7kksjzale1.png?width=90&format=png&auto=webp&s=1928ef392dfb8b5e358409534b31d8ccdd52fa46

3109
 
 
The original post: /r/datahoarder by /u/Ruinous_Calamity on 2025-02-25 15:22:14.

Original Title: Trying to digitize tapes with JVC HR-S7722 + AVI TV Wonder 600 USB s-video capture card. Getting flickering rectangles in VirtualDub AVI capture view. Any guess as to what's causing it? Works fine on TV with s-video input but for some reason the capture flickers really badly.

3110
 
 
The original post: /r/datahoarder by /u/nanoamp on 2025-02-25 15:02:45.

I've got a Terra-Master F5-221 NAS, running OMV7 on Debian 6 (from an external NVMe disk instead of the NAS's native OS). It's used for backup/media storage with 4x 12TB WD Reds in linux software RAID5, and runs a few Docker services, including Plex, Mosquitto, WebDAV etc.

It's starting to suffer from a hardware failure, as it drops off the network roughly once a week with nothing to see in the logs apart from occasional page faults. So, I'm thinking about replacing before it becomes terminal, and trying to work out what direction to take.

Its replacement needs to be fairly small, quiet and headless, to reuse the HDDs, and to support Docker. I want to retain some kind of disk redundancy, and if I can get away without rebuilding the current RAID array, that'd certainly be a plus. Ideally, I'd like something with a bit more CPU headroom than the 2GHz Celeron in the current NAS, to make Plex more performant. I'm comfortable with both linux/macOS already.

I can think of a variety of different ways to go:

  • upgrade to newer Terra-Master NAS hardware (and likely stick with the OMV boot)
  • migrate to another NAS brand that natively supports Docker
  • buy/build a linux mini-PC and a DAS enclosure (though I've never done DAS, so I'm not clear whether that'd be easily software RAIDable, or particularly performant if so)
  • buy a Mac Mini M4 and a DAS enclosure (some DAS reportedly don't like recent macOS though)
  • something else?

I'm in the UK, so any solution would need to use internationally available hardware (eg. that I can get on Amazon). I'd really welcome advice on which of these approaches is good or bad, and why? And if I'm missing a better solution for this sort of system in 2025, what is it?

3111
 
 
The original post: /r/datahoarder by /u/thearniec on 2025-02-25 14:43:05.

For reference: these are files being stored and organized in my Plex library.

Years ago I got a collection of SNL Seasons 1 - 40. They're all AVI files.

Recently I got a collection of SNL Seasons 1 - 50. Also all AVI files.

Some of these files are most likely identical (same file size to the KB). But some are different. The earlier the season the more different the file sizes.

What is the most efficient way of determining which episode I should put on my Plex server for an SNL rewatch? I mean, I COULD pull all the files into premiere pro and examine both resolution and length (thinking anything substantially longer will have stuff that was cut in reruns/on Peacock due to rights issues). But that would take me days.

I can do the "compare file size" by hand and pick the bigger file and just cross my fingers, but that's still highly manual, time consuming, and not very accurate.

Then...this IS DataHoarder after all...I'm loathe to delete the file that isn't chosen in case there's a mistake. If the file sizes are identical then I'm okay deleting the duplicate--no reason to keep the same file twice on the same hard drive--but when there are differences, what's the most organized way to keep them? I don't want to put both episodes together and just let Plex randomly decide which one to play.

Thanks for all the hoarding advice!

3112
 
 
The original post: /r/datahoarder by /u/VikingNinjaSquirrel on 2025-02-25 14:35:09.

Hey everyone,

I'm looking to get my first NAS and could use some advice on choosing between the Synology DS224+ and the UGREEN DXP2800. I'm completely new to NAS setups, so ease of use and reliability are important to me.

My main use cases:

  1. Photo storage & easy access (ideally with a user-friendly app - right now I am using Google Photos)
  2. Document storage & organization
  3. Centralizing my large music collection (currently scattered across multiple HDDs)
  4. Experimenting with Plex/Jellyfin (not sure yet if I'll need transcoding)

I’d love to hear from those who have experience with either of these NAS models. Which one would be a better fit for a beginner? Are there any major downsides to either?

3113
 
 
The original post: /r/datahoarder by /u/JeebsFat on 2025-02-25 14:12:43.

Not sure if this is good to post here or not. Seeking suggestions for hardware. If not, please remove.

I think I'm looking for an n100 (w/ case or not, at least 3x SATA, at least 2x M.2).

I'm trying to build a second NAS for Truenas Scale to serve solely as a off-site (weekly(?)) backup server. Don't need high performance, but stability and low power (+low cost-ish). So, I think a good option would be a n100 based system. Would you agree?

I'm feeling overwhelmed with the options. I've seen some that have a enclosure plus drive bays, but I have some old random cases I could use if I can find just the board itself, or board with power. I'm happy to jerry rig something.

It seems like a 12th gen 4core would be more than enough. I need about 3x SATA ports and 2x M.2 ports *system + cache ). 1gig ethernet is fine.

Thanks for any pointers!

3114
 
 
The original post: /r/datahoarder by /u/rslegacy86 on 2025-02-25 11:11:54.

Hi all. I've obtained a used 3.5 12TB HDD, now looking to do a full read/write surface test before putting into service. My previously largest 4TB external USB HDD took around 13hrs. I'd prefer to run the test at a time it's least at risks of disruption from knocks/shaky washing machine next room, but if it takes nearly 40hrs that's a real challenge...so shortening the time is of interest. I intend to run it in a 3.5 enclosure that has 1xUSB3 and 1xUSB2 plug to run into the PC.

I'd appreciate if any of you highly experienced folk had guidance on what is most likely the limiting factor for surface scan speed? From CPU of the PC, to the enclosure, to the drive itself? I'm also open to any other guidance in general.

Thank you!

3115
 
 
The original post: /r/datahoarder by /u/Crastinator_Pro on 2025-02-25 11:07:40.

I have certain software that only works with directly-attached-storage (DAS), external USB drives are fine, but network storage is a no-go.

I currently have a SW workaround that tricks the OS into believing the NAS is DAS, but this comes at a significant performance overhead.

Are there NAS products that can present the same storage as DAS for one machine, ideally via thunderbolt, and as NAS for the rest of the network via Ethernet?

3116
 
 
The original post: /r/datahoarder by /u/lyndamkellam on 2025-02-25 10:41:27.

I wanted to come back and thank this community for all of the support during the past few weeks. We were really busy for a while there but I have a some updates about the group.

  • We have a website: https://www.datarescueproject.org/ and a newsletter function you can sign up for. We are only doing posts once or twice a week at most.
  • The more active place is still the bluesky account: https://bsky.app/profile/datarescueproject.org
  • A more interesting development is that we've created a Data Rescue Tracker: https://www.datarescueproject.org/data-rescue-tracker/ To help us coordinate and track the various efforts happening to rescue data. This has gained traction and we have several data sources coming soon into the tracker (hopefully). It won't be perfect (it is free and built by volunteers) but it will give us a starting point.
    • You can submit datasets you know about especially if they in places that might be super findable.
  • We are going to start gathering public data user impact stories. I've talked some with the media and they really want to know how people are being impacted by the loss. It would help us to make the case of importance if we have specific things we can point to. I am creating a form where people can submit these (anonymously if they want), but you can also reach out to us.

Let me know if you have any questions about this! Again, we have really appreciated the support and help.

3117
 
 
The original post: /r/datahoarder by /u/Such-Bench-3199 on 2025-02-25 04:35:43.

I am in the process of cloning a WD 16TB Home Duo to a stock standard Seagate no fan, not networked normal external drive (see previous posts) and I am unsure if I am doing something wrong or could find some way of speeding up the process.

Through many files on the original 16TB, I am transferring 11TB, I have already endured 33 hours and 40 minutes, to transfer 3.62TB. 11 hours and 42 minutes for 1.26TB.

Even though I am autistic I did not inherit the math gene, and can't figure out, in layman's terms, exactly how long it would take.

Just hit 8 hours for 914GB

Could I improve it somehow?

3118
 
 
The original post: /r/datahoarder by /u/melow_shri on 2025-02-25 01:59:57.

I've tried searching for ways to archive Twitter/X threads in order to have copies of them in case they're deleted or their posters get suspended or deactivated. However, none of sites (e.g., archive.org, archive.ph, etc) or methods (saving to PDF) I've found is capable of saving entire threads together with their multimedia content. Anyone know of a site or a way to do this? Any solutions offered will be highly appreciated. Thanks in advance.

3119
 
 
The original post: /r/datahoarder by /u/Hits1015 on 2025-02-25 01:58:33.

An external hard drive failure this weekend made me question everything about what I'm doing. I'm a 4+ decade voice actor and my job requires creating sample montages of short clips of my work called Demos. Through the years I've accumulated literally hundreds of hours of audio files - because of my daily 'auditions' for jobs - (sample reads of a given script that is recorded and returned to clients or agents). As an OCD perfectionist, I have allowed myself to keep - without any structured 'cataloguing' routine - tens of thousands of these files -spread across multiple computers and hard drives - in multiple locations. Every few years I should be doing updates of these demos that promote my work...but the sheer volume and scope of what I've hoarded has made this a monumentally daunting task to the extent that I've not updated anything significantly in at least ten years. For context I'll add that at this point, i technically do not really "have" to work anymore - and i am at traditional retirement age - but it has always frustrated me, feeling like i am not representing myself with the best showcase of my abilities and versatility etc. When I begin going back through these countless archives, I naturally reach burn-out pretty quickly, going into a sort of numb state where i rationalize that i really don't "have" to DO this at all... however my ego drives me to want to finalize something great to replace all the outdated shit that is on my websites promoting me. What all this work is about is finding the "best" representative sample of a given style or "tone" of read... but SO much of my stuff is basically the same. I'm just too close to it all to say, hey, this is nothing special - and delete a file without thinking about it again. In fact I get a genuine sense of relief every time i DO delete something...as much so as finding something that I think is really exceptional.

Maybe this isn't a relatable context for this forum, but it seemed appropriate to post here when I thought more about it. I've heard the stuff about breaking things into 'smaller' tasks but -- what it is more about...is that my objectivity varies greatly in reviewing my own work. One day I can just wholesale plow through all these files and say, 'these are nothing special' and delete them... the next, i'm listening to stuff and it's painstaking to make a decision - I'm saying...no...that's pretty good..i should save that - but in reality it's probably very similar to 100 other things i've already listened through. Sorry for the long-winded ramble here but I'd welcome any perspective on how i might better approach all this. Thanks!

3120
 
 
The original post: /r/datahoarder by /u/No-Seaweed5270 on 2025-02-25 01:26:54.

Hey guys, I'm collecting PDF books and I'm looking for software that will OCR the text and allow searching the contents of all the books at once in a local Windows environment. Thanks!

3121
 
 
The original post: /r/datahoarder by /u/RandomHuman1002 on 2025-02-25 01:15:46.

Basically I want to have regular scheduled backup of my laptops stored in my google drive. It has unlimited storage. Last time I tried to do it I was not able to do it properly. So I want any advice on how to do it properly this time. I am kind of new to this so simple instruction/guides/tools would be helpful.

3122
 
 
The original post: /r/datahoarder by /u/Smileyface1200 on 2025-02-25 01:05:14.

Hey everyone, I’m new to Streamlink GUI and having trouble understanding it. I was wondering if anyone could help me out. I came across the app while researching, but I have little to no experience with it—though I’m eager to learn. I couldn’t find many tutorials on downloading streams, but I did manage to find one that helped me set it up and watch a stream on VLC.

My goal: I want to download an entire Twitch livestream, whether it’s already ended or still in progress.

Can anyone help me out?

3123
 
 
The original post: /r/datahoarder by /u/Yaxaf on 2025-02-24 23:40:43.

I’ve been digitalizing tapes and have had all the same issue trying to convert about half of them, being no video output and sped up audio. Everything else was converted on the same VHS with no problem. I believe the remaining tapes are likely PAL so I’ll likely pay someone to convert them, like costco, since PAL region VHS players tend to be expensive. I just want to make sure they are PAL before I move on, I’ve already checked for labels on all of them and don’t see anything.

3124
 
 
The original post: /r/datahoarder by /u/two2tee on 2025-02-24 22:16:41.

Hey guys,

I'm looking to create a backup system for my family photos and videos, and I don't need to store anything else. I expect my total storage needs will probably never exceed 4-5 TB over the span of many years.

I’ve been considering using NAS and RAID configurations combined with cloud backup.

Would RAID 0 with cloud backup be a good option to minimize drive costs, or would RAID 1 with cloud backup offer better safety? Or is there another setup that would be more ideal for my needs?

Finally, should I go for a 4-bay NAS, or is that overkill? Would it be better to stick with a 2-bay and save some money?

A scenario I consider is that whenever a device from my household connects to my home network, they would automatically sync their media files to the NAS, which in turn would back that data up into the cloud as an offsite backup.

I’d love to get advice on a reliable, efficient setup that minimizes risk while keeping the costs manageable.

Thanks!

3125
 
 
The original post: /r/datahoarder by /u/weirdkidinthecorner on 2025-02-24 21:43:53.

I need to purchase a external data storage device. I need to store photos/videos/audio files from apple and windows devices.

Looking for 2TB of storage, with a $200 budget.

Some file sizes are over 32gb.

The idea is to just plug in via USB to my laptops and dump all my files into the external storage device.

Can anyone make recommendations? Something off of Amazon would be preferable as I have gift cards available to use.

Idk if I should go for a flash drive, an external hard drive? Formats? Etc..

view more: ‹ prev next ›