It's A Digital Disease!

The original post: /r/datahoarder by /u/tmobley03 on 2024-07-06 19:08:27.

So, in 2013 Steam fully transitioned to their Steam3 system, in a process known as Steampipe. This changed their delivery method of games, and as such if you've ever used SteamDB, you know these old Steam3 depots can be downloaded.

Well, Valve didn't transition any of their Steam2 content over to this new system, effectively killing them overnight.

If anyone here has steam installs backed up with any games installed, you most certainly have lost files. The most important files would be what is in your steamapps folder, as that holds all the game content itself. (They came in .GCF files, or .NCF files which were just an index and then all the game files themselves were loose). Another important file is the clientregistry.blob file, kept at the root of the install, tracked what the current app record of Steam was the last time you updated the client.

If you can spare it, archiving the entire client would be great too, but that's a second priority to the actual game content itself.

Thanks :)

The original post: /r/datahoarder by /u/--ae on 2024-07-06 17:58:02.

Should I splurge on a 5 bay external hard drive enclosure now and slowly add more drives to it over time (planning on getting exos x18 18TB drives) Or should I just buy a single hard drive enclosure and upgrade to more later.

I'm not sure how I would expand from having 1 hard drive to more using Raid as this is my first so would it be better to save up and get all 5 drives at once or just start out with 1?

Also I plan to eventually upgrade my gaming pc and use my old parts to build a much better NAS not using the macmini (i9 9900k with a large enough case to hold quire a few drives).

The original post: /r/datahoarder by /u/Trick-Yogurtcloset45 on 2024-07-06 16:39:22.

We have 2 Synology DS1821+ with 60+ TB of storage each in a RAID 0 config. (I'm aware of the risks)

We back up everything from Synology 1 to Synology 2 daily. The backup takes no more than 2 hours to complete.

It seems wasteful (drives wear, electricity) to keep Synology 2 ON 24/7, or is it really?

Give me your opinions on this. Is it wise to set a schedule on Synology 2 say for only 3 hours ON time or leave it running 24/7?

Apologize if this is not the right sub!

The original post: /r/datahoarder by /u/Buergermeeschter on 2024-07-06 15:46:26.

Wondering if this would work/break anything/be useful at all? Basically, the idea would be to drop Bitlocker with a password on top of the partition that's revealed after a Samsung T7/T9 is unlocked

Meaning, data access would require both a Samsung password as well as a Bitlocker password

Does it make sense to do this? Are there any obvious caveats I'd be overlooking?

The original post: /r/datahoarder by /u/Michelfungelo on 2024-07-06 15:19:59.

The program would be ideal, but without refreshing it is absolutely useless to me

The original post: /r/datahoarder by /u/midhun956 on 2024-07-06 14:25:08.

If im buying a long an external storage solution, maybe 1tb or 500gb which is better? I just recently learned more about ssd TBW. So after a long time and amount of data written the ssd will fail.

I was looking to make a diy external 1tb ssd with an enclosure(crucial BX500 and zebronics CSH01 enclosure). Or should i buy a wd elements 1.5tb hdd?

The original post: /r/datahoarder by /u/IoueReal on 2024-07-06 13:20:25.

If I would buy a hard drive and not touch it, would it break like a used drive? Or would it possibly last for 30+ years if kept in optimal storage conditions? What about external hard drives? Would they last the same amount of time? And more importantly, what causes a drive to break except physical shock and issues present from the factory?

The original post: /r/datahoarder by /u/generaluser123 on 2024-07-06 13:12:22.

How does Hetzner storage box compare to the enterprise cloud storage products? It's very competitive price wise but is it suitable for light weight enterprise storage purposes?

The original post: /r/datahoarder by /u/ebridgewater on 2024-07-06 13:04:24.

I am using the following command:

wayback_machine_downloader http://www.elliotsworld.co.uk

However, I get the following back:

C:\Windows\System32>wayback_machine_downloader http://www.elliotsworld.co.uk
Downloading http://www.elliotsworld.co.uk to websites/www.elliotsworld.co.uk/ from Wayback Machine archives.

Getting snapshot pages.................................C:/Ruby33-x64/lib/ruby/3.3.0/net/protocol.rb:46:in `connect_nonblock': An existing connection was forcibly closed by the remote host. - SSL_connect (Errno::ECONNRESET)
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/protocol.rb:46:in `ssl_socket_connect'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1674:in `connect'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1580:in `do_start'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1569:in `start'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:334:in `open_http'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:770:in `buffer_open'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:220:in `block in open_loop'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in `catch'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in `open_loop'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:158:in `open_uri'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:750:in `open'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in `get_raw_list_from_api'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in `block in get_all_snapshots_to_consider'
        from <internal:numeric>:237:in `times'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in `get_all_snapshots_to_consider'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in `get_file_list_curated'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in `get_file_list_by_timestamp'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in `file_list_by_timestamp'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in `download_files'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in `<top (required)>'
        from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in `load'
        from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in `<main>'

Any ideas?

The original post: /r/datahoarder by /u/burielocks on 2024-07-06 12:36:11.

Don't know if this is the right place to ask, please let me know.

So there is a music album on MySpace that I want to get the cover from. I found the image I want but it's really small. Does anyone know how to enlarge it? Or is it stuck at 70x70? I tried the inspect tool to look for the image with no luck.

The original post: /r/datahoarder by /u/Minute-Angel on 2024-07-06 11:21:27.

I'm trying to watch some videos on an online course I bought but it seems like the videos are now encrypted and they are decrypted on the fly as a stream in the browser.

I've tried every download video extension on Chrome, Firefox, and external tools like IDM and FDM. It ends up downloading separate video and audio files but you can't hear or see anything.

Apart from using OBS, is there any other way I can download this and decrypt on the fly?

The original post: /r/datahoarder by /u/muzzledmasses on 2024-07-06 10:05:43.

I have usenet with drunkenslug, nzbgeek, nzb.su. My books take up very little space. But I'd like to build an 8tb library and going 1 by 1 isn't cutting it. I tried searching for books on the new yorks best seller list and no search results came up in readarr.

Also, Sonarr lets me add trakt playlists. Is there anything like that but for books?

The original post: /r/datahoarder by /u/Endercraft_O on 2024-07-06 07:44:57.

I want to setup a NAS to act as a backup and a means of synchronizing my devices. Specifically I want to be able to backup directories on different devices onto the same directory in the NAS. I looked at Kopia but it seems to attach a host prefix to each snapshot so doesn't seem like it would work. What backup software options do I have?

The original post: /r/datahoarder by /u/uni-twit on 2024-07-06 06:55:52.

I've got some old data sitting on a 9 inch reel and 600DC QIC format tapes that I'd like to extract. The tapes contain old files, email from long-passed friends, etc. in UNIX format (tar, dump).

Computer-Convert lists my exact media, but the cost is pretty high so hoped to find some recommendations for alternatives. I know it's going to cost a bit, but I'd love to get these files extracted assuming the media is still readable. Thanks!

The original post: /r/datahoarder by /u/SpiritualSpecific282 on 2024-07-06 06:11:44.

I have a 2 terabyte exstrnal hard drive I tride pluging it into my computer at it says I need to format it but I have 1.5 terabytes worth of data on it is there a way to recover it

The original post: /r/datahoarder by /u/HellraiserMob on 2024-07-06 05:26:47.

I have 2x 4TB Toshiba HDDs and 1x 4TB Samsung SSD.

I prefer the SSD for its speed and ease of use.

What's a good program to maintain and check the health of these storage devices?

They store family vacation, military, and overseas trip videos, and I want to ensure these memories are safe for the long term.

I saw in another post about a program that “resaves/ relocates all the files periodically so they don’t fail to load later on” or something of the sort,

Any tips or advice is welcome,

PS. Id also love to one day buy one of those 20TB storage devices but I’m not sure not there reliability

The original post: /r/datahoarder by /u/clerbird321 on 2024-07-05 17:21:28.

I’ve made a few posts in the last couple days regarding backing up my photos and videos from iCloud, as I discovered that iCloud doesn’t actually backup and is just used a syncing method. I’m anxious about the possibility of losing my precious photos and videos.

I’ve read a bit about M-Discs and such, and am wondering if those would be a good choice to store and view photos and videos from iCloud? Is there any other optical media that would be a better choice? What kind of disc drive do I need for these options? How often would they need to be replaced?

They would be left in a drawer for the most part, only being picked up every month or other month to add more photos and videos.

I only have a laptop with not enough storage to keep my photos and videos, so I’m looking into these other options.

Also, just to add this on, I also want to know what the best cloud backup option could be? I have Google Photos but I’m weary to use it because I know that whatever is deleted from Google Photos is also deleted from iCloud, and what if something happens with Google Photos and it deletes everything from both? I’d ideally like to have a cloud that is kind of separate from iCloud, one where I can delete from one without it deleting from the other and vice versa. I looked into Shutterfly as they have unlimited photo storage with a purchase every 18 months and also paid video storage, does anyone else use this?

The original post: /r/datahoarder by /u/clerbird321 on 2024-07-05 16:48:00.

I’ve been so stressed over the last few days because I discovered that iCloud isn’t actually a backup solution, and now I’m incredibly anxious about backing up my precious memories in photos and videos on my iPhone. I bought this yesterday (https://www.walmart.com/ip/790131533) and copied most of my iCloud library to it, still need to finish it tonight. I’m hoping that is a reliable way to backup.

I also want to get another drive, and am wondering whether I should get another external HDD, or an external SSD, or something internal with a case? I don’t know much about this stuff, all I know is that apparently you can buy an internal drive and put it in a case of some sort. How about M-Discs? Where can I reliably buy those? What kind of DVD drive do I need for them? It will be sitting in a drawer for the most part, untouched other than plugging it in every month or other month to add more pics and videos.

I also want to know what the best cloud backup option could be? I have Google Photos but I’m weary to use it because I know that whatever is deleted from Google Photos is also deleted from iCloud, and what if something happens with Google Photos and it deletes everything from both? I’d ideally like to have a cloud that is kind of separate from iCloud, one where I can delete from one without it deleting from the other and vice versa. I looked into Shutterfly as they have unlimited photo storage with a purchase every 18 months and also paid video storage, does anyone else use this?

I only have a laptop, and it doesn’t have enough storage on it for all of my photos and videos to reside, so I’m trying other options.

Thank you in advance, this is all super stressful and I just want to make sure my memories are safe.

The original post: /r/datahoarder by /u/OldDragonfruit471 on 2024-07-05 16:37:14.

Hi! I'm trying to download all photos that this account has posted. Any simple way to do this without having to download each album individually? I am not super duper technical (I'm not a boomer either lmao...) and I work on macOS.

This is the profile I am talking about: https://www.flickr.com/photos/projectapolloarchive/albums/

The original post: /r/datahoarder by /u/mad-jester69 on 2024-07-05 16:06:56.

I've bought a few TeamGroup CX2 SATA SSDs about a year or two ago since they were so cheap, and they seem to handle their primary function of "storing data". I put some data on them, and put them in mostly "cold storage". A year later, I've noticed read speeds of under 10 MB/s on them (as opposed to the usual 400+ MB/s).

I was puzzled at first, but now I think I understand what happened. They leak charge in cold storage, which results in the controller having to spend more time reconstructing the data. If I write any new data on them, then this data has normal read speed, but anything "old" remains slow. So, the solution is to copy all the data somewhere else and then back, or simply duplicate all data "in-place", then remove the "old" copies.

This finally gave me a revelation. The reason no one cares about wear, and everyone seems to care about the controller instead, is because normally, the controller is supposed to detect "rotten" data automatically, and "refresh" it even without the user noticing! So, as long as you keep the SSD plugged in, as opposed to often recommended "cold storage", it will take care of everything on its own! No matter if your memory cells leak in even under a month - it will be noticed in time and refreshed!

My cheap SSD, however, seems to lack this capability. I've tried leaving it plugged in for the whole night, and nothing changed. So apparently this is the answer to my question, "what is the difference between a crap-tier SSD and a good one". I don't think I've encountered this on my old MLC/TLC Goodram Iridiums. Maybe the memory chip type also plays a role here.

I wonder if any owners of TeamGroup CX2 series could either confirm or disprove this explanation.

And there is one more thing that comes to mind. Could it be that the controller does not in fact do that on its own, but needs some kind of SMART command to run some kind of self-test? It is most likely that my Linux setup does not issue those to USB-attached storage. Maybe instead of copying all the data, I could simply issue a command to start the test, and leave it plugged in for a day or two? I am aware of the existence of something called "SMART self-tests", but not aware of what they actually do or if they are supposed to be automatically issued from time to time during normal operation.

The original post: /r/datahoarder by /u/Nirbhik on 2024-07-05 13:30:11.

As in title. After doing some initial research I found that Pcloud and Icedrive provides what seems to be 10TB lifetime subscriptions. Others like icloud, dropbox and drive all have yearly subscription. Another thing I noticed is that at high capacities some services also charge for egress of data? How do you go about choosing the best option? Whats the approach to deciding?

The original post: /r/datahoarder by /u/teppeishogun on 2024-07-05 13:09:39.

Recently, I just got a 4TB WD HDD, and I’m using its cable for my 1TB Seagate as well.

I noticed that the transfer rate of the Seagate drive, when using the WD cable, is twice as fast as the cable that came with it, and they look almost identical. So now I only use that cable for both my HDD. But are there any downsides if I do that for long-term use?

The original post: /r/datahoarder by /u/Critical-Substance90 on 2024-07-05 12:48:10.

I have a real debrid account and am willing to mirror some files on Rapidgator into my Gdrive. It's a lot of hard work to download and upload em manually while the files are around 750GB. I heard that Premiumize has a transfer option, but I've never used their service before.

The original post: /r/datahoarder by /u/Consistent_Ad7426 on 2024-07-05 08:34:46.

The original post: /r/datahoarder by /u/JustAnotherPodcaster on 2024-07-06 02:34:58.

I'm not sure if anyone posted this yet. I saw this earlier this morning and I was just surprised I didn't see anything about it on this subreddit. I searched but I couldn't find it.

Maybe I don't understand and it's not a big deal but I thought that 61 TB SSD is pretty serious especially when they say they can make something double that as well.

Samsung just dropped a 61TB SSD, says it could make a 122TB drive https://www.pcgamesn.com/samsung/122tb-bm1743-ssd

Edit: I just found someone posting it yesterday on another subreddit: https://www.reddit.com/r/technews/s/1R8PAV27g1