It's A Digital Disease!

The original post: /r/datahoarder by /u/kyleraymondwalker on 2024-09-19 22:02:46.

I am a videographer and frequently transfer my data to an external SSD and also a HHD RAID and finals files to the cloud.

I recently picked up a SAMSUNG T9 Portable SSD with USB 3.2 and 2,000 M/Bs write speeds. Things were goin fine until I noticed certain green, black, and pink glitches appearing in my footage while editing. I went to the video file on my SSD where the footage was transferred and it was baked into the file itself. Then I checked on the source file still on my CFast card that came from the camera and the footage was clean of any glitches.

My only conclusion is that it came from some issue during the transfer of data. Does anyone know why this issue is happening?

I currently use a Anker 10GBs PD controlled USB type c hub with 3 ports to hook up my T9 SSD and my CFast card reader to transfer between the two.

Ryzen 5900x

64 GB DDR4 RAM

RTX 3070

The original post: /r/datahoarder by /u/lmr-1 on 2024-09-19 21:55:09.

Hey, I have some old android devices I would like to backup some apks from, but I'm not sure how. Both devices are over a decade old each, so i'm not sure if installing something such as google files on them is viable. I'm wondering if anyone have any good ideas as to what I can do, I thought maybe I could use a wired connection to my PC and use my PC to get the apks, but i haven't tried yet.

The original post: /r/datahoarder by /u/RxBrad on 2024-09-19 21:43:57.

I learned today that SnapRAID syncs aren't actually supposed to take 2-3+ hours every single time. If no files change since the last sync, it takes mere seconds.

Depending on your settings, the -arrs will update the timestamps on your media to match the original release date. In doing so, they use a DD-MM-YYYY HH:MM:00:00 format.

SnapRAID gets mad about any file with exactly zero subseconds in the timestamp, and nudges you to update the timestamp with snapraid touch. This adds a RANDOM non-zero subsecond value to the timestamp. 'snapraid touch' is also part of many recommended scripts that people use to manage SnapRAID.

Unfortunately, if you have the -arrs setup to update timestamps on rescan, this resets that timestamp back to zero nanoseconds. Then snapraid touch picks another random number of nanoseconds. Over & over & over this repeats. Every time it does, it throws off SnapRAID's parity for those files, and forces a full re-sync.

What I'm saying is that if you use SnapRAID and the -arrs, you probably want to either disable the "Change File Date" option, or limit rescanning of folders to "Never" or "After Manual Refresh" (knowing that a manual refresh in that -arr will force a full SnapRAID re-sync of that library).

https://preview.redd.it/kzxh172e5upd1.png?width=660&format=png&auto=webp&s=090238111d1910ad6bbcebd5e744ade6088aa1ab

The original post: /r/datahoarder by /u/GensHaze on 2024-09-19 20:07:49.

Or should I up the jank??

https://preview.redd.it/hs7mra9nntpd1.jpg?width=900&format=pjpg&auto=webp&s=79ef4d1e30c2546349037445db5f5cbe6a32f58c

The original post: /r/datahoarder by /u/ALT703 on 2024-09-19 19:49:29.

I have too much data and not enough safely backed up. It's all kinda spread across different devices and I want to consolidate it all in a safe place. I recently got two identical 2TB hard drives, figured it's a great opportunity to make my own DAS.

I don't have the money to buy enough drives for a proper RAID 5 or something, so I'm just going with Raid 1. I know it cuts my storage in half but 2TB is fine for now and I REALLY just don't want to lose data if one of the drives fails

My main question is what's the best way to set it up? I'm thinking raspberry pi 4 with USB to Sata adapters, and I've heard I can set the Pi to act as a mass storage device?

This seems like the simplest option, any advice or tips that may be better? I don't care much about having it be attached to my network, offline is fine. I don't really want to deal with security or anything.

Never build a storage device so really just looking for any tips anyone might have. Also, I have a 3rd 2TB drive but it's older and used and different brand. Should I use all 3 or just use the 2 identical new ones for my setup?

But yeah I'm thinking raspberry pi, USB to sata adapters, and then also thinking of implementing indicator lights for the drives and maybe an alert system if a drive goes down. Thoughts?

The original post: /r/datahoarder by /u/danimal1986 on 2024-09-19 17:57:45.

I'm going to be swapping my PSU in my unraid server to a Corsair RM1000x and getting rid of janky sata power splitters.

Anyone know if i'll run into any issues with white labeled shucked drives powering? I've got kapton tape handy, but just wondering if anyone has experience with this RM psu's and shcuked drives.

figured this would be the best place to ask.

The original post: /r/datahoarder by /u/Far_Marsupial6303 on 2024-09-19 17:29:01.

https://www.tomshardware.com/pc-components/hdds/toshiba-launches-cmr-24tb-and-smr-28tb-hdds-for-data-centers-and-hyperscalers

The original post: /r/datahoarder by /u/Narrow_Substance_100 on 2024-09-19 17:19:59.

Hi folks - my old NAS box (Netgear Stora MS2000) appears to have died. Long story but, despite performing a factory reset, I can ping it but it won't respond to anything else other than to immediately refuse credentials.

So, I'm left with a mirrored RAID array of two XFS (I believe) drives that I need to be able to access in Windows. Until I sort out a replacement NAS, I figure I'll get a third NTFS drive and copy the contents over, but can anyone suggest the best way to go about this? I've got a spare PC that I could install Linux on and plug them into, but my Linux experience is minimal and I'm a bit nervous about corrupting my data by diving in feet first.

Any advice would be greatly appreciated.

The original post: /r/datahoarder by /u/Odd_Anxiety5027 on 2024-09-19 17:11:26.

I'm thinking about buying this white label OEM hdd:

https://www.ebay.ca/itm/305184665231?_skw=wl+oem&itmmeta=01J85M07R8PP2DRAJPMYZRRHDN&hash=item470e6c6e8f:g:f~0AAOSwJ5pmJpnz

It's significantly cheaper than the other refurbished drives. Is there a large quality/reliability difference compared to branded drives? Are white label OEM drives worth purchasing?

The original post: /r/datahoarder by /u/dadumir_party on 2024-09-19 17:10:35.

I'm an idiot. I'm not looking for help because there's nothing to do (my phone isn't rooted so I can't recover them after emptying the recycle bin), I just want to vent.

Whatsapp users will know that since last June or so, our automatic backups are eating up a LOT of space on our Google accounts. My backup (without videos) was over 9 GB and as a result my Google account was more than 97% full, so I wanted to free up some space.

I don't have a real backup plan for my phone, I just hooked it up to my laptop via USB from time to time and copied whatever I wanted to keep, then deleted duplicates. First red flag.

So I did this time too. It was slow and frustrating because the copy process kept getting stuck. I had to manually copy each folder, check after a minute if it was working, cancel the copy, delete the empty folder it created and start it again. Never during this whole thing did I stop and wonder if there was a better way to do it, which of course there is, there have to be a million better ways. But I've always done it this way and nothing ever went wrong (as far as I know), so out of laziness I kept doing it with the slow and painful method. Second red flag.

Near the end I was so frustrated that I didn't check the folders. This was the final nail in the coffin of a terrible backup. The "Whatsapp Images" folder was completely empty but I didn't realize until earlier today, almost a week after I deleted the stuff from my phone. Of course it was too big for the recycle bin, so it went directly into the Abyss.

All the pictures I was sent in the last five years are gone for good.

I'd like to end this on a lighter note, maybe say that I learned something out of this experience, but I'm not sure I learned anything. I'll probably keep doing stuff the wrong way because I'm lazy.

So the moral of the story is probably this: don't be lazy, kids.

The original post: /r/datahoarder by /u/htplex on 2024-09-19 16:58:39.

The original post: /r/datahoarder by /u/al3arabcoreleone on 2024-09-19 16:45:28.

The most recent course captures are from 2018, are there legal matters that stopping students from contributing to the project ?

The original post: /r/datahoarder by /u/StellarOwl on 2024-09-19 16:17:08.

https://gist.github.com/jamiephan/0c04986c7f2e62d5c87c4e8c8ce115fc

u/jamiephan created a script to easily claim all assets on Quixel if anyone is interested

The original post: /r/datahoarder by /u/mediamuesli on 2024-09-19 16:12:57.

The original post: /r/datahoarder by /u/Get_Triggered76 on 2024-09-19 14:39:24.

I am not looking for a software that detect all types of duplicate. I tried freefilesync, but it doesn't compare pixels in image and visipics will try to show every single images that are similar to each other.

I am constantly downloading new images, and it get harder to track if I have already downloaded the same image. I need a software that can tell me if I already have downloaded the same content.

The original post: /r/datahoarder by /u/hamada147 on 2024-09-19 13:25:10.

I have a few experts in my field who share fantastic content. They sometimes go live, answer Q&As, and explain a whole subject in detail. I want to download the content locally as a backup. How do I go about that?!

The original post: /r/datahoarder by /u/joe346 on 2024-09-19 11:42:18.

The original post: /r/datahoarder by /u/fellowspecies on 2024-09-19 11:09:50.

I'm trying to build a Miro library and this site has some great assets but I'm loathe to download them all individually. Does anyone still have the file that was created on this thread? It's no longer valid.

https://www.reddit.com/r/DataHoarder/comments/lj4ju6/browse_300000_svg_vectors_and_icons_free/

TIA

The original post: /r/datahoarder by /u/sveltedelight on 2024-09-19 09:21:55.

I've been googling this for a while, but only find virtual tape services.

I currently use Backblaze B2 to backup files, but I've got over 140tb and the price is quite costly. The files are RAW video files, so can't really be compressed any further. It's my business, so I do have a budget for this, but it's becoming quite expensive.

Main question Is there a service that runs tape drives which allows you to backup your data to tapes and physically just stores the tapes for you. An LTO-9 can store 45tb and costs 150usd. I'd only need 3 tapes and storage can't cost more than 10usd a tape per month?

I'd imagine the price of the service would be cheaper than AWS Glacier Deep Archive Storage.

If this doesn't exist, I think there'd definitely be a market for it for the more entrepreneurially minded.

I currently use Synology Cloud Sync for some data and Veeam for the rest.

Other options I'm thinking of:

• Colocating an old server / synology NAS. I normally do Raid-10, is this still the best advice for large 3.5 spinning rust?
• Colocating a tape server. I've never touched tape before and don’t own a machine, but was thinking I could buy an LTO-7/8 drive. The price of the hardware seems like it might actually not be cheaper.

The original post: /r/datahoarder by /u/stoke1863 on 2024-09-19 09:21:35.

Ok currently i have all my years weddings (only from 2022) stored locally on my PC and also mirrored to my Synology NAS.

I think i need to get these files online as well literally just incase of emergency at the home (fire, destruction ect)

My idea was that any of my previous years files i do not need fast immediate retrieval or access its literally just emergency data.

Is it possible/good idea to keep my current years photos on something like Backblaze B2, these files will be be getting updated throughout the year and backup with something like Hyper Backup.

And for all previous years works, i could just get that into something like Amazon S3 Glazier Deep Archive? This would literally be a once a year data change (current work goes into deep storage in the next year)

my thoughts being the bulk of the data size (maybe 5TB on Glazier vs 1TB on Backblaze) would keep costs down, and the retrieval fees for Glazier wouldnt be used as it would just be an emeregency pull down.

Can i use a Hyper Backup task to store into Glazier deep archive?

The original post: /r/datahoarder by /u/seronlover on 2024-09-19 09:04:55.

I just removed around 100GB of duplicates on my drive and there is still more.

So I just wanted to share it with others.

I guess it is normal for duplicates to pop up the more data accumulates.

The original post: /r/datahoarder by /u/steviefaux on 2024-09-19 08:47:11.

Jay Blade. Probably not known to people outside of the UK. Made a great show The Repair Shop. Now he's been accused of a crime (yet not found guility yet), the papers, of which I try and avoid reading especially the Daily Mirror, all keep falsely saying "His shows are or have been removed from streaming services". Why? He hasn't been found guilty yet. The BBC has no spine and are now claiming they won't air new episodes he appears in. So its guilty until proven innocent.

Anyway. I've already backed up that show and again, this shitty Mirror article

https://www.mirror.co.uk/3am/celebrity-news/jay-blades-deletes-social-media-33700891

Claims "David & Jay’s Touring Toolshed" has also been removed from streaming, but it hasn't, its still on iplayer.

Even if found guilty, the show, The Repair Shop has become so popular, it can't be chopped up due to the one bad apple. There are plenty of other craft folk on the show that have done good work.

I don't mind paying the TV license (as I don't want adverts with the BBC), although I guess it should just go to a subscription model now so people who don't want to pay don't have to. However, it annoys me that shows like The Repair Shop are allowed to die. We've lost pretty much all the old episodes of Flog It because the BBC just won't stream them. Yet Channel 4, stream a large chunck of their old shows so why can't the BBC. Same with Antiques Roadshow, I started to back those up because a lot of the old episodes from the early years are gone. Someone has a large chunk, or they did, on YouTube of some 90s episodes but really the BBC should stream them, themselves.

The original post: /r/datahoarder by /u/TraditionalTask9945 on 2024-09-19 07:59:17.

Sorry for wall of text. Not native english so apologies for the terrible grammar.

Copying 5TB of media files from one external to a another. No folders, all are files.

Copying from exfat, to a brand new that I am planning to format to ntsf (was recommended this instead of exfat).

Reason for exfat was that the harddrives need to work with nvidial shield, different OS. But changing since I have been told that that exfat is risky.

I am a beginner so all I know how to copy with robocopy now is: robocopy "the from folder with the files" "the new drive".

The quotation marks is what pops up in cmd when I right click the folder and copy the what you call it in english file location path or something.

Doing this on a laptop so have disabled the battery saving stuff with the usb ports, windows turn them off to save power, but disabled that so they dont.

Turned the sleep and shut down option to "never turn off" and so forth.

Did I miss anything? Looking for any heads up, tips, does and donts. Again I am a beginner, have used robocopy now with little sizes to test waters: 1gb, 5gb, 10gb, and want to get going copying these files. They are important.

The original post: /r/datahoarder by /u/personguy4440 on 2024-09-19 07:51:26.

The original post: /r/datahoarder by /u/oShievy on 2024-09-19 07:28:48.

https://preview.redd.it/jj6h004cxppd1.png?width=1022&format=png&auto=webp&s=ed73f934db896dfae2b5a44e2cdeceaf833e55d2

https://preview.redd.it/r2qucbygxppd1.png?width=178&format=png&auto=webp&s=be3c6c132c0514ec4dcfcbaf89704368fc7fbd35

Was wondering if anyone has bought from ServerPartDeals on Amazon? They have super fast shipping compared to the actual site, so I was considering just buying from here. I'm also assuming that the ServerPartDeals warranty would be applied?