It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
2151
 
 
The original post: /r/datahoarder by /u/Lob- on 2025-04-09 22:43:23.

Forgive me for being a complete newb in this area. I recently got a bigger NVME drive and want to transfer the data on it to the new drive. It's not much data and it's nothing terribly important, in this case my Steam library which totals to 1.5 TB. I'm also inquiring because I do intend to backup/copy family photos/videos later on down the road and want to make sure it's done so safely without corruption or loss.

I see many different recommendations ranging from robocopy, teracopy, fastcopy, freefilesync. I narrowed down the software that interested me.

The programs that I'm looking into so far are robocopy, fastcopy, and freefilesync. Fastcopy and freefilesync seems pretty straight foward but if there is anything I should know about those programs before hand I would very much appreciate any tips.

As for robocopy, this is a bit intimidating as it doesn't include a GUI. I did see people talk about choeazycopy but read some people recommend against it cause it causes slow downs? Not sure how accurate that is... let me know if that's just misinformation. In regards to using it via cmd line, what would be the perfect setting I could use (basically copy & paste someone's setting) for the stuff mentioned above? ex. Copying data to another drive without deleting destination drive or Mirroring a drive if I intend to upgrade the storage size.

Appreciate any advice!

2152
 
 
The original post: /r/datahoarder by /u/MundaneRevenue5127 on 2025-04-09 22:27:26.

I'm a fan of the metadata files that you can collect with yt-dlp, especially comments, very nice to have when preserving volatile channels. So I had an AI python script made which can convert all of the metadata it creates into a functional HTML file with CSS and Javascript. It works on an entire directory of files.

Preview Image: https://ibb.co/0RbqMt1f

The best feature is probably sorting up to hundreds of thousands of comments (at once) by Longest length, Most likes, Most replies, or alphabetically. I couldn't manage to implement chronological sorting though, maybe it's possible but comment timestamps didn't help. Also it can't play video files; doesn't seem possible with static HTML in this context.

Pastebin Script Link: https://pastebin.com/L7supm6m

Script download: https://drive.google.com/file/d/1FYYIZMkjNzMWEnKcTAeiLYiErJU1cSiz

Example HTML : https://drive.google.com/file/d/1xdhNIBfQiTdviSTzhEbWCZywVk8r4qvC

I'm not going to say this is an advanced thing but I think it looks good for what it is, it took several hours to get functioning/looking the way I wanted, debug, test new stuff. If you wanted you could probably redesign it to look more like the old youtube layout, but it'd take awhile probably, AI can't really one shot it.

Currently it can display basically everything in a fake youtube page with a functioning description and comment section. As well as several buttons to copy metadata, and a few links and tooltips for relevant stuff.

I think this is most useful for archiving videos/channels that could get deleted, I do this proactively with certain channels. So for every video you archive, you could have an HTML file with it to search comments. From what I can tell the HTML files can open directly from Internet Archive, and render it's own page.

The Wayback Machine doesn't have functional comment sections, or archives any comments at all, so this at least is superior in that aspect. Of course, it depends on the day you archive the comments.

Features

  • Visual representation of a possibly deleted video. Title, description, thumbnail (if the video isn't deleted), comments, tons of other info. I tried to get it to play video files/thumbnails in the HTML after its opened, pretty sure its not possible. If the video is deleted, thumbnails won't render because google links are deleted.
  • All comments can be rendered, chronological sorting isn't possible but you can sort by Most Likes, Most Replies, Longest Length, Alphabetically. (This itself could be really interesting on its own to search comment sections). I got all comments on "Stronger" by Kanye to load at once, took a few minutes for 100K comments.
  • Copy channel URL or Channel Handle of the video creator, or any commenter. Clicking a commenter profile picture opens it in a new tab, 64x64 resolution, it looks like a channel thumbnail downloader finds higher quality links though.
  • FakeTube logo, Open the original video link in new tab, and links to beginner-oriented archive tutorial documents I've made (+ other scripts). If you don't want the links there, you could just remove the "tutorial-links-container" and CSS styling.
  • A button to open the original script in a pastebin link.
  • Additional info section that has things like tags, video length, format, and bitrate.
  • Schedule date of some videos (90% sure that's what timestamp refers to), functional description, buttons with hover effects.
  • Functional dislike bar with % ratio tooltip (only if the json file is pre-2022). Very niche application but it works.
  • Verified checkmarks, favorited comments, pinned comments (display "Pinned" rather than at the top of the comments).

I tried getting comments sorted by Newest, but certain jsons files had the exact same timestamp for each comment, while others didn't and you could sort of sort them by date. But no matter what, the exact timestamp (UTC 00:00:00) would be the same for each comment. This is most noticeable in replies, they had to be sorted by most likes which kinda sucks. There is a "time_text" on comments like what youtube has, which is relative to the json creation date, but it's not precise.

Also I couldn't find an uploader profile picture link, unless the uploader made a comment on their own video; if not it displays as "N/A". Commenter profile pictures work just fine though unless they change them. It does rely on google links for images, so if the links are deprecated they won't show up. Couldn't find a way around this.

If something is glitchy, or there's a missed opportunity, I'm open to suggestions. I'm by no means a yt-dlp expert

2153
 
 
The original post: /r/datahoarder by /u/Pasta-hobo on 2025-04-09 21:20:00.

It spins down after like 45 seconds. I can't even pause a video off of it without it spinning down and needing to wait like 45 seconds for it to spin back up. and to top it all off, it's externally powered.

it's one of these ones, btw.

2154
 
 
The original post: /r/datahoarder by /u/xkcx123 on 2025-04-09 22:15:32.

How will warranties of products be effected by tariffs ?

For example having to send something to Japan, Korea or China for warranty support will there be tariffs.

2155
 
 
The original post: /r/datahoarder by /u/ZDRoberts81 on 2025-04-09 18:19:21.

I've got about 10 small SSD drives (like the Crucial X9pro) and add one about every three months from my work and need some sort of case to hold them. I'm looking at getting a pelican style case with foam inserts but that feels a bit overkill? Anyone have any solutions?

I also have older portable 3.5inch drives just in a box and probably should deal with those too...

2156
 
 
The original post: /r/datahoarder by /u/Storxusmc on 2025-04-09 17:44:39.

I am currently rebuilding my unRaid server with new Intel 265k, was looking at my hard drives, which are 8tb refurbished enterprise drives. I noticed my oldest one is from 2009, most are marked 2012.

2157
 
 
The original post: /r/datahoarder by /u/Storxusmc on 2025-04-09 17:44:33.

I am currently rebuilding my unRaid server with new Intel 265k, was looking at my hard drives, which are 8tb refurbished enterprise drives. I noticed my oldest one is from 2009, most are marked 2012.

2158
 
 
The original post: /r/datahoarder by /u/ManlyMorgan on 2025-04-09 17:29:10.

I've been trying to extract the 3D model of this Dell monitor, out of the 3D viewer Here.

I've tried using the network tab to see what is loaded, but it seems that the file is stored as a .dat file, with no way of reverting it back to a 3D model file. Was wondering if anyone had another way of extracting the 3D model. Thanks

2159
 
 
The original post: /r/datahoarder by /u/wolfplayer0 on 2025-04-09 17:26:44.

Thought that this might be a good place to ask. I've got lots of photos and videos dating to several years back, and I've been looking around for info about what counts as an "offline backup". Is it as simple as an extra drive you put files in and nothing else? Should I use some sort of program? I couldn't find a consistent answer online, and people keep suggesting different things.

What exactly should I do to make a simple backup for my files? And I'm not talking about a 3-2-1 rule type of thing, I get the concept. I'm asking, what exactly counts as a backup? How do I know I've backed up my files? I feel I'm overthinking things, but yeah.

2160
 
 
The original post: /r/datahoarder by /u/Deep-Egg-6167 on 2025-04-09 17:25:46.

Hello,

I know you like linux and unraid but let's talk Windows 11 24h2 16 x 20TB. I have the drives and I have a controller. I have multiple backups using smaller servers. I'm about to set it up from scratch. I'm thinking it will be about 270tb which as far as I know is over the ntfs limit. I never used REFS before.

Short of using unraid, linux, raid6 within the parameters of Windows 11 what would you do?

Thanks

2161
 
 
The original post: /r/datahoarder by /u/Different_Suit8805 on 2025-04-09 16:55:57.

Having issues recovering a formatted micro sd card

I formatted my micro sd card on my camera by mistake . Took 2-3 days then I was able to get access to my computer , put the micro sd card in adapter and on read only mode, then into computer.

I proceeded to scan with whatever site I tried at the time.

Nothing is working so far. I tried the sandisk application for recovery and it said; “no files can be found“

Tried recuva and the only thing being found is 10 files that with this info ;

File name: PP-101.db-journal Path: D:\MISC
Last modified: 4/3/2025 Size: 9KB (one is 512bytes) State: unrecoverable Comment : this file is overwritten with “D:\DCIM”

Why is it saying “unrecoverable” on the “state” ? I did not use the ssd card anymore when it was formatted . Hopefully I provided enough information to help me solve this issue , thanks

Edit ; Micro sd card , not ssd

2162
 
 
The original post: /r/datahoarder by /u/kursadx3 on 2025-04-09 16:52:55.

I am using a MacBook for the last couple of years for my workflow. I have used windows for 15 years for hoarding my data , editing my videos , saving family files , saving personal data and gaming. Now I only use my windows machine for gaming and gaming alone since I want my workflow to be as productive as possible and MacOS is the way to go for my case.

I lost all my files after a tragedy happened in my life that I dont really want to talk about.

I get lucky to recover some of my old pictures from some of my drives I had .

I never ever knew how hdds worked and that you need to have ATLEAST two coppies of your data.

Lately I have been always but always making a copy of my most important data on two other drives and when I can afford it I want to buy a NAS so I can put it in some other location for my data backup.

I watched valuable amounts of videos about data protection and doing your best to have your data saved.

Now I have couple of questions that I want to ask and maybe in the future just upgrade this post when I cant find some answers I need that I couldn't find online.

As if right now I want to sync two external hard drives Simultaneously when I plug the hard drive I want to have a copy in.

Let me say it like this , A and B hard drives . I will be working on hard drive A and when I am done I want to plug hard drive B and want all the changes and stuff to be copied to hard drive B .

I dont want to manually do it and spend all the time on going through the files and waste so much time .

I know CCC (Carbon copy cloner) can do what I exactly want. But as if right now I cant afford 50 dolar for it , because in future when I expend my workflow I want to be able to data copy and sync or maybe clone my drives on my windows machine as well but as I found out there isn't a windows app for CCC.

I dont want to use way to many apps for one job.

So I came across and app called Freefilesync. Where I can use it on both OS .

Read about it online that they had some malware in it before and some people says it was not as people thing ETC.

What are your guys experiencing on that topic , what would you recommend?

Thank you so much if you read it all and I appercite all the comments thank you again.

https://preview.redd.it/g4ojdskhaute1.jpg?width=1920&format=pjpg&auto=webp&s=d623ac75e8dc53cc4e9bdf69f008836a4164b952

2163
 
 
The original post: /r/datahoarder by /u/Electrical-Gene-3800 on 2025-04-09 16:50:31.

I've been hoarding for two years, but I never called myself one since I always told myself that all those hentai were for "future personal use", but now I believe its basically hoarding rather than storing. On the flip side, I live in 3rd world and tech products are expensive so its not like I can buy a 400TB HDD amalgamation, and when I see people saying 20TBs (my entire space) is just a minor upgrade for them I'm thinking about leaving this to professionals. Does hoarding even mean anything at small scales like that?

2164
 
 
The original post: /r/datahoarder by /u/stuid001 on 2025-04-09 16:41:44.

I've been trying to lower the size of an almost 1 GB pdf to something smaller. Any ideas on how to do it?

2165
 
 
The original post: /r/datahoarder by /u/DrTransient on 2025-04-09 14:50:55.

Hey everyone! I’m on the hunt for old episodes of The Dave Ramsey Show from around 2003 to 2015. If anyone happens to have recordings—whether it's audio files, DVDs, or even old saved broadcasts—I’d be incredibly grateful to get a copy or just hear more about what you’ve got. Feel free to reach out if you can help. Thanks so much!

2166
 
 
The original post: /r/datahoarder by /u/northparkbv on 2025-04-09 13:59:13.
2167
 
 
The original post: /r/datahoarder by /u/MisterBandwidth on 2025-04-09 11:39:03.

I'd like to replace my existing home NAS and have the following components in mind:

The HBA has a single SFF-8654 port. The case has a two backplanes with 4 SATA ports each.

My question is: what kind of cable do I need to get from 1x SFF-8654 to 8x SATA?

Big thanks for help and/or suggestions!

2168
 
 
The original post: /r/datahoarder by /u/Due-Rip-5860 on 2025-04-09 11:36:11.

Mississippi libraries ordered to delete academic research in response to state laws Lawmaker says the removal of scholarly material from library databases would provoke backlash in a state where minorities have fought for equal access to education.

From the article :

“”“”The two research collections state officials ordered for deletion included material from professional journals, conference papers, books, student dissertations, periodicals and newspaper articles.

The Gender Studies Database included academic content from 377 peer reviewed journals. Subjects include, “Gender inequality, Masculinity, Post-feminism (and) Gender identity.” The other deleted database, titled “Race Relations Abstracts” focused on a wide range of subjects, including “Ethnic studies, Discrimination, Immigration studies (and) Ideology.””

2169
 
 
The original post: /r/datahoarder by /u/TimTams553 on 2025-04-09 10:21:17.

Heya

So I have a Storage Space striped across 4x 4TB SSDs, one of which has died. No biggie, it's just a media collection.

What I'm wondering is: is there a way to force-mount the storage space, even though the files will be corrupt, so that I can copy them off, re-add the torrents to my downloader, and drop the files in so it can scan for the corruption and redownload the missing chunks?

Ta

2170
 
 
The original post: /r/datahoarder by /u/500xp1 on 2025-04-09 10:13:39.
2171
 
 
The original post: /r/datahoarder by /u/thedroolingboogeyman on 2025-04-09 07:03:13.

So i transfered a bunch of zip files to my sandisk extreme pro usb. It got 512 gb and the total storage of the file was 257. Can someone tell me how did a 257 gb drive turn into 439? And is there a fix for this?

2172
 
 
The original post: /r/datahoarder by /u/TheLostWanderer47 on 2025-04-09 07:02:30.
2173
 
 
The original post: /r/datahoarder by /u/hbenthow on 2025-04-09 04:30:57.

I'm looking for reliable 50GB BD-Rs at a reasonable price. So far, Verbatim VBR260RP50SV1 discs look like potentially the best option, as a spindle of 50 is available for about $63 (shipped from Japan).

However, I reading the Amazon reviews, I saw some possible reason for concern. Some of the more recent reviews claim that the discs are not reliable anymore and have a high failure rate, and sometimes can even form bubbles/blisters during the burning process.

Are these discs still reliable (other than perhaps a bad batch here and there), or have they gone too far downhill to be reliable.

This is the Amazon page in question:

https://www.amazon.com/Verbatim-Sheets-White-Printerable-Double/dp/B01AL5KA9O

2174
 
 
The original post: /r/datahoarder by /u/hamiecod on 2025-04-09 03:45:40.

I am fine tuning an AI model to act like an AI girlfriend. Too bad, I have deleted all chats with my girlfriend ever since she broke up as I loved my work more than her.

At this point, I do not know how to even ask because this is not a joke.

2175
 
 
The original post: /r/datahoarder by /u/piefanart on 2025-04-09 03:26:37.
view more: ‹ prev next ›