It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
9251
 
 
The original post: /r/datahoarder by /u/Commercial_Union_296 on 2024-06-10 15:53:29.

How were you able to save your emails from many years back?

9252
 
 
9253
 
 
The original post: /r/datahoarder by /u/EUOS_the_cat on 2024-06-10 14:34:19.

Let me know if this isn't the right sub for this, and if it isn't, point me in the right direction please.

I'm on a mission to extract models from old Littlest Pet Shop games (PC, Wii), and unfortunately they were made by EA. Me and another person have looked into it, and the models are stored in the .big format. These have ways to be opened, however they lead to the .rpk files that have no information that either of us could find on how to get into. The only info about them I see is that they're used as skins for RadLight, which obviously isn't what these files are.

If anyone knows a way to get into these files, I'd be very thankful.

9254
 
 
The original post: /r/datahoarder by /u/valdearg on 2024-06-10 14:26:30.

Completely forgot about this from https://old.reddit.com/r/DataHoarder/comments/18tlukv/cgsociety_is_closing_up_soon_decades_of_valuable/

https://archive.org/details/cgsocietyarchive

It's about 300GB+

Images has JSON files with their metadata alongside it.

Torrent needs to be regenerated I think, not sure if there's a way to do that.

9255
 
 
The original post: /r/datahoarder by /u/ripperdoc on 2024-06-10 14:22:44.

New to this subreddit. For long believed in manual cataloguing but I’m starting to feel I don’t have time for that. What’s the go to software for automatically cataloguing data, from documents to websites to media?

9256
 
 
The original post: /r/datahoarder by /u/KingRollos on 2024-06-10 14:21:07.

I'm thinking of moving most of my backup to Amazon's deep freeze service. I'm sure it's made complicated deliberately.

I'm thinking of adding it in bits. Will this cost me more? Do I need to gather it all together and then transfer in 1 go?

9257
 
 
The original post: /r/datahoarder by /u/ProFalseIdol on 2024-06-10 11:00:10.

I am looking for at least 1TB to store videos and pictures. Travel a lot, so it has to be as convenient and compact as a Flash thumb drive. I saw plenty of recommendations of using NVMe + enclosure for portable consumer storage.

Then I saw the SSK Portable options (while looking for their enclosure).. Also the Crucial X6..

https://www.amazon.com/SSK-Portable-External-MacBook-Laptops/dp/B0CL94LX9W?ref_=ast_sto_dp&th=1

What are the pros and cons? For 87 USD, you have a ready to use USB C or A portable solution. Got a new laptop with USB 4 and USB-C 3.2 Gen 2 ports (I assume I can get that sweet 2000 MB/s read/write)..

Versus an M.2 NVMe + enclosure that I probably will never upgrade and will be permanently external as if I bought a Thumb drive..

TIA!

9258
 
 
The original post: /r/datahoarder by /u/Redditarianist on 2024-06-10 09:58:44.

As the title states. I'm looking to upload around 16 thousand podcasted files to the Internet Archive & am looking for the best way.

Is there an RSS ingest system at all?

9259
 
 
The original post: /r/datahoarder by /u/aradbe on 2024-06-10 08:17:46.

Hey all,

so pretty simple, im looking for a cloud service where can i backup some of my important files so ill have them in case i lose them.

i dont know much about this kinda stuff amd im looking for something simple and reliable, i was interested to see if thers a service where i can start off with purchasing a sub for a set amount of storage and if i want more later i can add a few dollars and expand the storage. like maybe start out with 100gb and expand it to 200gb if i need it later.

If there nothing like then i would just like a recommendation for a good reliable backup service that will do the job.

Thanks for any replies !

9260
 
 
The original post: /r/datahoarder by /u/TheHornedGod on 2024-06-10 08:09:56.

I stumbled across this while doing some research and noticed there are no threads here about it. I'm late to the party on this but I thought if there are some people already on the case then maybe users from this subreddit might be interested in finding them to help with backups and hosting.

The NOAA is shutting down some of their online and printed services and they are removing that data from their websites. This project actually began in 2021 and is set to be completed in 2025.

So what is the RNC?

NOAA's RNC Tile Service (WMTS)

The NOAA RNC Tile Service provides standardized nautical chart tilesets for the public, eliminating the need for application developers to regularly undergo the cumbersome process of transforming NOAA BSB files into tilesets. It provides geo-referenced charts compatible with the Web Map Tile Specifications (WMTS) and Tile Map Service Specification (TMS). All tilesets are published on a weekly basis.

Original website (already deleted?): https://tileservice.charts.noaa.gov

Their annoucement:

NOAA will shut down its Raster Navigational Chart (RNC) Tile Service and the online RNC Viewer on October 1, 2021. The NOAA Seamless Raster Navigational Chart Services will be shut down on January 1, 2022. This is part of a larger NOAA program to end production and maintenance of all NOAA traditional paper and raster nautical charts that was announced in the Federal Register in November 2019.

Cancellation of traditional NOAA paper nautical charts and associated raster nautical chart products, such as BookletCharts™ and Raster Navigational Charts (RNC) will occur over the next four years and be completed by January 2025. More information about this overarching program to “sunset” traditional nautical chart products is available on the “Farewell to Traditional Nautical Charts” web page.

-- source

Why help with this project?

The abandoned nautical tilesets and paper charts have been replaced with GIS offerings for modern equipment, however these older documents were a failsafe for smaller vessels and operations. They may not have the technical know how to backup and retrieve this data otherwise.

9261
 
 
The original post: /r/datahoarder by /u/sweetestpeach94 on 2024-06-10 07:29:15.

Hi, I hope I can get some help. I have a Lacie 2big thunderbolt 2 set as Raid 1. I’ve just completed the backup of almost 6TB of data (mainly pics), however half of it are just the mirror copies. Now I would move the original half on another disk, the problem is that the backup isn’t like sort out in different folders, it’s just every file and its copy back to back in sequence all together (file A, file A-2 , file B, file B-2, file C, file C - 2 etc.). So here is my question, how I select just one half of the files to move it in the new disk without their duplicate?

9262
 
 
The original post: /r/datahoarder by /u/No-Balance-8038 on 2024-06-10 07:21:58.

Need a way to protect my backup disks that are meant to be stored offsite.

I already got cases, but they are too small to account for a 3.5" HDD plus the mount for SilverStone Technology RM43-320-RS.

What would you guys recommend? I live in Germany. From Amazon would be cool.

I already have 3.5" Protection cases but they are not long enough!

The HDDs are 17cm long with it.

9263
 
 
The original post: /r/datahoarder by /u/retrorays on 2024-06-10 05:59:55.

I read how USB drives can run malware to act as a USB keyboard and then compromise your system. I see the SSK drives are from China. Do we know if they are safe?

9264
 
 
The original post: /r/datahoarder by /u/1michaelbrown on 2024-06-10 05:40:57.

The title pretty much explains what I’m asking. I want to know if it’s worth it since most dvds only provide 480p. Would it be worth it upscaling it to 1080p. With FFmpeg.

I plan on buying 100” screen and projector. If that matters

What I am using to encode with. I can use either.

Mac mini M1 Or Dell power edge r620 with Debian vm With two cpus with a total of 40 cores.

I plan on using FFmpeg via command line. (Some inside thoughts I want to make a script that will kind of automate this process. Checking if upscaling is needed or not)

I am new here I hope this post is the right place.

9265
 
 
The original post: /r/datahoarder by /u/Ripcitytoker on 2024-06-10 04:18:32.

I personally always save videos in the highest quality possible, regardless of how much storage it takes u. Does anyone else do this or do you download videos in lower quality (like 1080p instead of 4k) in order to use up less storage space?

9266
 
 
The original post: /r/datahoarder by /u/ass-master-blaster on 2024-06-10 02:00:38.

The V600 is discontinued in my country (past prices are around $650) and the V850 is too expensive ($1600). Are there any alternatives around the same price and quality for a newer model scanner? I've looked at the FastFoto and don't like the quality of the photos and am happy to spend the time with a flatbed scanner.

9267
 
 
The original post: /r/datahoarder by /u/MisterPenishead on 2024-06-10 01:56:46.

I have a hard drive with thousands of files spread across different folders and some of the files have the same name in spite of them having different content. Is there a software I can use to find all files with identical names so that I can rename them?

9268
 
 
The original post: /r/datahoarder by /u/sbourwest on 2024-06-10 00:12:00.

My Dad has a pretty extensive collection of movies (close to 6,000), and his only real method for cataloguing is a private streaming platform (Emby), but he's interested in creating a database for all of his content, but doesn't want to have to populate the whole thing himself, he'd rather be able to just type in the media and have it pull from online databases like IMDB or the like.

He would prefer PC software, no mobile apps or online-only (have to register an account) platforms, browser-based is fine though.

I've tried doing a bit of looking myself but most personal film cataloguing software is focused on physical media (DVDs, Blu-Rays, etc.) and not a digital collection.

9269
 
 
The original post: /r/datahoarder by /u/OnenonlyAl on 2024-06-10 00:06:42.

Thanks for taking the time to read and comment. I'm looking to backup a zpool of media. I had tried to setup a truenas for the data but I didn't love the UI and I have what I need on Ubuntu with docker. My plan is to destroy a zpool of the truenas made of 4x10tb raidz1 and move that pool into the primary server (add a pcie with more sata ports) then use zpool attach to mirror my current 4x8tb raidz1 (mnt) to the newly recreated zpool of the 4x10tb from the old truenas server (named mntbackup). So zpool attach mnt to mntbackup. Sounds like this automatically starts mirroring.

I know this isn't ideal without being an off-site backup but I'm not the most literate at actually managing this and want something easy. Would I be able to just plug in backup, then unplug the backup pool and cold storage? I don't need perfect redundancy. Would I be able to plug the mntbackup raidz1 back in sometime in the future and the missing new data automatically sync or would I need scripts of rysnc or zfs send receive to add new data?

Thanks for any insight and help!

9270
 
 
The original post: /r/datahoarder by /u/CyberpunkLover on 2024-06-09 23:52:06.

I've been collecting music video clips for about 15 years now, and collected something like 85k clips.

I've been putting everything on hard drives, then after filling them up, moving everything to larger drive.

The last drive I've used was some Western Digital Blue 8TB drive, and last week it filled up, so I purchased a new 20TB drive and was about to copy everything into it, but before I could do that, the WD drive failed.

I've used few file restoration programs, and managed to salvage about 80% of everything that was on the drive, but the problem is, like 70% of what I've restored is either corrupted, or doesn't have audio. And all the files were put into ~75 different folders, with around 900 or so files each.

I'd like to sort out the files with audio and without, in order to save the good ones and get rid of the bad ones.

All files were renamed to random letters and numbers by recovery software, so the corrupted and muted files are basically completely useless to me, since I can't even use the file names to find out what files those are.

All the files are either .mp4, .mkv, .avi, .mov or .wmv.

Sorting through tens of thousands of files would take me months, and I just don't have the time or patience to do that. I've had the idea of importing files into video editing soft like Premiere and look at the generated waveform to find out good files, but there's quite a lot of files with codecs unsupported by Premiere, like VP09 and such, so vast majority of files, even with audio present show up as flat lines on Premiere waveform, thus this method is completely useless to me. Like, importing a folder of restored files only generates maybe 20-30 waveforms, the rest are flat lines, and so manual sorting is still required.

Anyone know of any software that can scan thousands of files and either mark or separate them by presence of audio, or have some other solution?

9271
 
 
The original post: /r/datahoarder by /u/Commercial_Union_296 on 2024-06-09 22:05:38.

My sent email archive goes back to 2013.

9272
 
 
The original post: /r/datahoarder by /u/Throwaway173638o on 2024-06-09 20:22:34.

I have a Sony Hi-Fi camera for 8mm videos that has a FireWire, Mini USB, A/V, and S-video ports. I want to get the highest quality as possible. I narrowed down to FireWire or Mini USB transfer for better quality. Which of the two is better overall or are they the same?

Edit: For context, the camera is a Sony DCR-TRV730 and the tapes are Sony Hi8 MP 8mm Video Cassette. Cassette also lists it as Digital8 with "60" while the Hi8 is listed as "120"

9273
 
 
The original post: /r/datahoarder by /u/allweretakenornot on 2024-06-09 19:59:25.

Hello! I long time lurker finally looking to break into data hoarding. My mom is looking to back up around a terabyte of photos and I was considering getting her a storage bay likely in RAID 1 to protect her data. Is there any recommended system? I was looking on Amazon and saw this 5 bay orico enclosure. Are these systems good? Should I try and find a cloud solution for her?

PS: I read the rules and saw that they recommended tech support. If this post is not in the nature of the subreddit please let me know! Happy hoarding!

9274
 
 
The original post: /r/datahoarder by /u/elgato123 on 2024-06-09 19:52:45.

Once tubeup downloads a youtube video and uploads it to archive.org, does it then delete the file locally? I can see a hard drive getting full fast if not.

9275
 
 
The original post: /r/datahoarder by /u/avattz on 2024-06-09 18:35:56.

I almost had a data loss scare yesterday with a Windows machine, luckily I managed to restore it, but this has lead to figuring out a file sync system for my machines in case one has an issue with the boot drive or hardware failure. I currently have a small RAID 1 file server running Samba and while I manually copy files from my computers to this server, I wanted to see if there was software that could automated this.

The goal is for this software to automatically copy a new completed file placed in the documents folder to a network drive that is available on the same computer. Literally "copy this file over there when it exists". I looked into FreeFileSync and Syncthing but these appear to sync directly to a server instead to a local folder.

One additional thing I an looking for is two-way syncing. This way, I can make a "universal" document folders where all my computers will have the same content, and update them if they are missing anything. This could count as additional backup since I would have the same files over many computers.

Does anyone have recommendations for a software solution?

Preferably:

  • Open source
  • "Live" syncing (runs when new or changed file detected instead of scheduled syncing)
  • Flexible / Plenty of Options / Configurable
  • Uses native Windows file commands
  • Doesn't hurt, but works on Linux (I have "better" options for my Linux machines though)

I appreciate any recommendations!

Edit: I remember SyncToy which would be perfect, if anyone knows of an open source version of SyncToy, then that would be what I am looking for!

view more: ‹ prev next ›