It's A Digital Disease!

The original post: /r/datahoarder by /u/deSenna24 on 2024-07-24 09:50:22.

Pulled the trigger on a new NAS and wondering what RAID setup I'll be using. Right now I've got a QNAP TS-231P3 with 2 disks in RAID 1 and 2 drives on the side unused in case of failure. My new system will be a 4-bay system and now I'm wondering how I'll set up the drives.

I'm thinking of using 3 drives with 1 on the side for swap in case of failure with a RAID 5, however, RAID 6 could also be an option where 2 drives can fail. RAID 10 is an other option but don't think it's more secure than RAID 6 though.

I'm going to be using 2TB Samsung datacenter SSD's (because of endurance) and a 10Gbe NIC, so speed is not that much of an issue for a RAID setup.

Would you suggest RAID 5 with 3 drives and an unused spare on the side to swap in case of failure or just going for a RAID 6 setup and use all drives?

The original post: /r/datahoarder by /u/m4rkuscha on 2024-07-24 05:45:25.

Known Information:

The needed connector has been identified as Molex part number 436450400, the pinout is unknown, but the two middle Pins (2 and 3) seem to be connected to Ground

Hello,

I was able to score a LTO-6 Tape drive prior used inside a tape library, I've removed the sled from It, and It revealed to me that It uses Fibre Channel. The main issue is what I assume to be the 4-pin header on the left, I've been unable to identify what this header is or what It's pinout is (I assume it is used for power). Does anyone perhaps have any advice for identification?

Mystery 4-pin header (left), 2x SFP Ports (right)

4-pin header on the drive sled PCB

4-pin connector in question

The original post: /r/datahoarder by /u/le_velocirapetor on 2024-07-24 04:53:16.

Looking at getting a couple 24 TB to fill up some new bays and noticed these two separate drives on serverpartdeals I can't tell the difference between. It seems maybe its Exo vs Exo X but when I search online they both result in Exo X.

The original post: /r/datahoarder by /u/sovietcykablyat666 on 2024-07-24 04:11:51.

I want to create a VC file vault. Usually, on normal daily usage of HDs/SSDs it's recommended to let some free file, around 30%. It has to do with some technical aspect of accessing the files and causing less problems.

I want to know if this same logic applies when creating a VC file inside of an external HDD. Since I'm going to use all my external HDD size, do I need to have the file vault and some HDD free space? If so, how much? Chatgpt tells me about 10%. I have no idea if it's right.

BTW, I may be completely wrong, but by the small amount of posts I read, it looks like the file container is better even though I'm going to use all the external disk size.

I also didn't like the fact that when the external drive is connected, on this full partition method, the PC requests to format it. Of course, you can just deny, but it gives me some kind of anxiety.

Thanks in advance.

The original post: /r/datahoarder by /u/ardhnirmit on 2024-07-24 04:10:54.

Hi Folks, I need your help to download a video from a private telegram channel using webapp or a desktop app. Im using mac but windows solution would also work.

I tried running a script using tampermonkey it's working but the downloading speed is very slow 100-150kbps. Im on a high internet connection. I tried using network calls I checked media type and tried to save it but got an error saying "File wasn't available on site" Sharing more details on screenshots

The error in chrome:

{dcId1,_location{_inputDocumentFileLocation,_id5046472524238423226,access_hash**-9084783574744095171_,_file_reference**[5,0,0,0,0,133,47,240,134,0,0,1,214,102,159,244,150,74,216,15,242,151,55,23,139,132,15,205,100,37,163,2.mp4_}Failed - No file

This is the network calls file:

https://web.telegram.org/k/stream/%7B%22dcId%22%3A1%2C%22location%22%3A%7B%22_%22%3A%22inputDocumentFileLocation%22%2C%22id%22%3A%225046472524238423226%22%2C%22access_hash%22%3A%22-9084783574744095171%22%2C%22file_reference%22%3A%5B5%2C0%2C0%2C0%2C0%2C133%2C47%2C240%2C134%2C0%2C0%2C1%2C214%2C102%2C160%2C123%2C0%2C10%2C85%2C172%2C59%2C102%2C170%2C114%2C180%2C7%2C193%2C54%2C138%2C194%2C1%2C66%2C141%5D%7D%2C%22size%22%3A948340021%2C%22mimeType%22%3A%22video%2Fmp4%22%2C%22fileName%22%3A%22001)%20Maths%20Class%2001%20-%20250723.mp4%22%7D

The original post: /r/datahoarder by /u/ChillCaptain on 2024-07-24 04:00:40.

I have:

External seagate 14tb and 16tb drive External wd 20 tb essentials drive Internal wd 8tb and 6tb black drive

I’m considering grabbing 2 wd gold enterprise 24tb internal drives for my main pc.

How would the noise compare to my current setup?

Would the Gold drives be considerably louder than the external drives I have?

The original post: /r/datahoarder by /u/Actual-Paramedic2689 on 2024-07-23 21:23:45.

What are your favourite public data collections that you hoard?

The original post: /r/datahoarder by /u/lilgeemoney on 2024-07-23 11:06:39.

hi! so ive modded a members only community on livejournal for a while, but its not in use anymore. i want to keep an offline archive of the posts and comments in case i ever want to share or go back and view, but i'm having a little trouble putting together the right wget command.

i was originally putting this into terminal:

wget --no-check-certificate -r -c -p -k -E -e robots=off https://username:password@www.domain.com

but when id load the html file it would show as logged out and wouldn't show any posts (members only so posts are private). so i logged back in, saved my cookies using a firefox extension, and then amended the command so it would save the pages logged in as me.

wget --no-check-certificate -r -c -p -k -E -e robots=off --load-cookies cookies.txt https://username:password@www.domain.com

that worked! but only for the first page of posts. when i clicked to see previous posts it logged back out again.

any ideas? or suggestions for different tools to use? im a bit of a noob but eager to learn more!

thanks in advance

The original post: /r/datahoarder by /u/justtrifling on 2024-07-23 06:01:52.

I'm currently rebuilding my main pc which I run a jellyfin(jf) server on, plan is to take the pieces in it already and build another pc dubbed lil boy blue(lbb), run Funtoo on it and run jf in a docker, the case I'm buying only fits 3 hdd's, I plan to use 3x20tb hdds in a raid (I know, I know, raid is not a backup) issue is I have 5 hdds (its really 6 but one is not in use) that I'm currently using to host the media for my jf server and I wish to add them to the overall raid (will make for just a hair under 100tb), heres the question, since I am going to use lbb to run the jf server on, can't I just use a das? I know some people use a nas as a one stop shop and just run jf on the nas itself, but since I'm building lbb, I'm thinking the das would be the better way to go in my situation (and cheaper!) of course we start to get into read rates and the such and I'm thinking I have about at least a 10-15 user base (friends & family only and of course not all connected at once, maybe 3 to 4 users simultaneously watching things) I have 2.5gbit inet at the house and will be looking to upgrade to 10gbit sometime in the future as demand (and wallets!) grow, thank you in advance

The original post: /r/datahoarder by /u/vizcar on 2024-07-24 03:27:40.

Support page for teracopy says:

"You can repeat the verification process later to ensure the target files remain uncorrupted, even without the source devices present."

I'm probably thinking of this all wrong since I can't find a way to load the hashes I saved and try have it check the copy. Is this only if you still have it in history? I still have a source but I'm trying to what I can do to check if it's not convenient to drag it out and plug it back in.

The original post: /r/datahoarder by /u/Hamatoros on 2024-07-24 02:29:47.

The original post: /r/datahoarder by /u/SithLordRising on 2024-07-24 02:22:06.

Struggling to find exactly what model this is unless Red is simply what came before Plus and Pro? Can I look up the serial anywhere? (Checked WD without success)

https://preview.redd.it/wcmr93tpmded1.png?width=560&format=png&auto=webp&s=fcb6ba67c44225859786bb7242112c848cd13aed

The original post: /r/datahoarder by /u/JessSerrano on 2024-07-23 23:59:40.

Hello! I’m not sure if this is the proper place to ask but wanted to try.

I recently uploaded 1000s of photos over the span of the past 4 years off of my iPhone on to Google Drive through the app.

Unfortunately the date of the files are all yesterday and today. How can I change the dates to their original date?

Thank you!

The original post: /r/datahoarder by /u/desiigner1 on 2024-07-23 22:41:08.

Hi everyone,

I just got a new HDD earlier today for backup purposes and decided to check its health. I noticed that the raw read error rate and seek error rate values are significantly higher than the threshold. Should I return the drive, or should I test it with another tool before making a decision? I used AIDA64.

Thanks!

https://preview.redd.it/a1rzq356jced1.png?width=779&format=png&auto=webp&s=0da45fceb5fd88cbd5f8c3fd3766804bb63653c1

The original post: /r/datahoarder by /u/Jimbob14813 on 2024-07-23 22:24:19.

I have a 14TB drive that I host media on and use daily. I bought a clone of the same drive so that I could make a carbon copy backup and place it somewhere safe. The idea being, without daily use, it will last longer than the original. After the initial large backup I want to plug the new drive in only about once a month to get any new or changed files. Is this a simple copy/paste procedure? Or is there a better method/software/compression that would work in my use case?

The original post: /r/datahoarder by /u/Saint_The_Stig on 2024-07-23 21:57:39.

Long story short I got hit with a perfect storm at a bad time. My main NAS is full and I haven't had the spare cash to upgrade in a while. My D drive in my main PC (a 16TB WD Red Pro) is less than a year old but suddenly wasn't recognized in Windows.

I thought this was related to other issues I was working on in that PC. Problem was I was about to travel to see my family so instead of making a fresh backup right away I tried to get the drive back up to get some data I needed for the trip. I probably could have looked to get some key data off it in that time instead. I was able to get it to pop back up a few times before having no luck. Though I would say it was far from an exhaustive attempt given the limited time.

Anyway I'm about to head home and was wondering what my next steps would be. A lot of the data is backed up but it is not a recent one so attempting some recovery would be worth the time, especially with the down time I will have setting up and balancing a new upgraded NAS. Last it was connected all the data was there but the drive was failing to show in windows. So I think the data itself should be fine. I still need to try it on other systems, but that perfect storm involved me not having a good way to do that so I need to pick up a new drive caddy (why can't someone make an external drive carddy powered by USB C so I don't need one specific cord for it). Though I don't have high hopes.

I still need to do a check in the contents of the backup, but it might be worth to send the drive to get recovered, at least a quote. Being less than a year old (purchase) the drive should still be under warranty, but I don't want to send the drive in for a replacement if it means I can't try to recover data either by myself or through a service.

I also need to look at RAID of some sort on this PC so it's more resilient. Last I looked RAID for windows was recommended to use a hardware card but now I'm seeing software RAID being the answer. Can anyone point me to a good guide or something about good ways to set up drive arrays to ultimately use Windows these days.

The original post: /r/datahoarder by /u/AbrocomaNew1808 on 2024-07-23 21:11:22.

I’m not very experienced in tech, so forgive me for asking something that seems obvious. I did make sure to do some digging around online, but I still have not found any definitive solution, but I have a bunch of hard drives spanning decades that I need to consolidate onto one big, physical storage unit of some kind. What is the best but most affordable way to do this?

The original post: /r/datahoarder by /u/beermoneymike on 2024-07-23 20:29:16.

Purpose : low power, small footprint NAS for local/offsite backup

Budget : about $200 US

Parts available: 4x 2tb Gen 4 M.2 NVME, 4x 2TB SATA SSD, Intel i3-13100T CPU

Current machines: HP 600 G4 mini PC w/ WIN11, 76TB Unraid NAS, T480s ThinkPad

Hello all. I'm currently looking into replacing Google with Immich for my family pictures and movies storage. Immich will be hosted on my Unraid NAS and I'm waffling on what I should build as a backup. I was looking into a Pi 5 with the Radxa penta SATA hat, a cm3588 NVME NAS or converting a HP/Lenovo SFF prebuilt. Also, would a DAS connected to my mini PC satisfy the 3,2,1 rule if I count my phone as offsite storage? I'm all over the place and some ideas would be extremely helpful.

The original post: /r/datahoarder by /u/phatcrits on 2024-07-23 20:25:18.

I'm sick and tired of my ~3TB of internal storage. I'm tired of constantly deleting and re-downloading things, and it's time to upgrade. I do a mix of things that need fast storage and slow storage. These are gaming, stablediffusion/AI (No idea if storing checkpoints benefit from fast storage), VR, and media.

My current drives are 2x 1tb samsung 970 nvmes. 1x 256gb sata. 1x 512gb sata. Those sata drives are old as sin too. My motherboard is an ASUS ROG Strix Z490-e, which has 2 m.2 slots at pci3.0, and 6 SATA ports. If it matters I have a 4090 and 10700k.

I would love at 8-16tb of fast storage, and 30tb of slow storage. I don't know if that's realistic. I also don't know if motherboards even come with more than 2 m.2 slots. I haven't kept up with PC parts in a long time.

If I'm storing 30tb+ of media, would it be best to store that elsewhere like a NAS? Should I upgrade my motherboard to something that can utilize pci4.0 and get 2x 4tb m.2 drives? Would it be better to leave my current NVME drives and get multiple SATA drives? Money isn't exactly a concern but with all things tech there comes a point where you start doubling your investment for incremental gains, I want to stay out of that territory. Also I'm sure my 4090 is already bottlenecked by my 10700k so upgrading the motherboard and therefore CPU is something that I'll need to do eventually.

Whatever is best can someone suggest some specific drives for it?

The original post: /r/datahoarder by /u/Gaming2Night on 2024-07-23 20:21:22.

Help me decide which to buy, Seagate ,ironwolf ,barracuda

The original post: /r/datahoarder by /u/stuartlevy67 on 2024-07-23 20:11:19.

Hardware: LSI9305-16e HBA, a couple of 8-bay 2010-era external SATA/SAS enclosures, some ST6000NM0105 SAS drives.

Puzzle (+ explanation below): why weren't any of the drives detected?

One of the new 6TB SAS drives worked fine in another RAID array, so the drives seemed OK.

The same controller+cables+enclosure works fine with an assortment of older Seagate drives -- ST4000NM0085 (4Kn SATA) and ST3000NM0023 (512n SAS).

The intent was to replace a similar older setup using a RocketRaid 2744, which is no longer supported under Linux.

Some frantic searching turned up comments about a new (2017?) SAS feature, Power Disable. It redefines pin 3 of the power connector. If that pin is powered, the drive shuts itself off. Looking closely at the spec sheet for the ST6000NM0105 shows it has this feature.

(The Seagate ST000NM0023 was too old to have Power Disable - that's why it worked!)

One page about this feature ( https://serverpartdeals.com/blogs/news/what-are-power-disable-hard-drives ) suggests a little strip of kapton tape covering that pin on the drive side. I tested with a bit of easily-removable scotch tape. It's surprisingly hard to make a thin strip of tape and put it in the right spot - but, it did work. The scotch-taped drive spun up and behaved normally in the enclosure that hadn't recognized it before.

I don't want to use kapton tape for drives that I still might return - its adhesive is really strong, so I might not be able to remove it.

Checked out the enclosure's backplane - could I modify it instead? Did the power supply have a 3.3V lead that I could just cut? Answer: for my enclosure, no. It appears to generate 3.3V on the backplane PCB. Oh well. I am not going to cut traces on the backplane.

Hope this saves someone else some trouble. Check whether your enclosure provides power on SAS/SATA pin 3, and check the detailed spec sheet for the drive(s) to see whether it implements power disable.

The original post: /r/datahoarder by /u/JuriJurka on 2024-07-23 18:49:16.

Hey guys. i dont know where to ask this on reddit, but I think you must be the ones who can help me

i do social media marketing and i have on MEGA folders that i share to employees

but i get weird sync problems all the time... one time an employee by accident deleted the folder. and i couldnt even restore it LOL

mega seems like crap.... i bought now Google Drive but it is soooooooo slow, crazy slow

I really dont know what to try now

Dropbox, onedrive, i don't know. there's also not so much selection....

what do you guys recommend?

we don't even work at files at the same time. thats one more reason why all those MEGA sync problems are a nuissance to me. those sync problems come to prevent MEGA from deleting wrong data, and therefore asking me what to do

but it seems their sync just does not work properly...

there is LucidLink, but its expensive asf, and too overkill for me. Normal cloud is enough actually

The original post: /r/datahoarder by /u/ImaginationStatus184 on 2024-07-23 18:32:22.

So I am extremely new to hoarding but have already gotten extremely deep. I starting really building my collection about 3 years ago. I wanted to build the best retro gaming PC for me and my family to use when we are together.

I started out small and just downloading a lot of basic top 25-50 games on each system, but then ended up just downloading entire collections and the system has gotten MASSIVE.

I have video snaps, cover art, screen shots, and all kinds of other stuff that took me a long time to compile and it totals up to around 30TB

My question is, how do I go about backing up this much data without tying my computer up for 24 hours a day for over a week or whatever the time estimate said? There has got to be a faster way than just copy and paste onto a new drive right?

TIA

Edit: thank you guys. Seems my biggest fear is true. Once I reached 8tb I had the thought “I wish I had been keeping an extra copy of this the whole time. Oh well. I’ll figure it out later” which was probably the stupidest though I could have had at the time

The original post: /r/datahoarder by /u/bigdickwalrus on 2024-07-23 18:19:01.

Use case is long term data storage. I'm a video editor for my day job so I have TB's and TB's of footage, music, movies, roms, you name it. Not using a NAS enclosure system right now, in a few years I may invest but for now I'd like to get a 20TB+ drive to dump ALL my shit onto.

Definitely wanting CMR, probably helium, I don't want to skimp on anything. My biggest concern is picking a drive with the lowest advertised average failure rate. Not brand loyal whatsoever, though I feel very out of my depth having not bought a drive even close to this size in over a decade.

Can I find a drive like this with a SOLID warranty for under $350? I'm very ignorant of the finer details when it comes to performance outside of speed/capacity so please let me know if I'm missing anything.

Thanks folks <3

The original post: /r/datahoarder by /u/Hergrim on 2024-07-23 16:12:23.

EDIT: To be absolutely crystal clear, I'm not going to be using Blu Ray to back up tens of terabytes of data, I'm going to be building a NAS server and important/valuable/critical files (as well as my computer) will also be backed up to the cloud.

The last year or so I've been hit with a few reminders about how ephemeral the internet is and how some nostalgic media from my childhood never got a VHS/DVD release and only now exists because someone managed to record it on their TV back in the day. Some of it may not even exist on the internet anymore, living on in a couple of private hard drives (including a couple of mine).

Anyway, I've decided that I'm going to actually try backing up some of my physical media as well as duplicating some digital files, backing up my digital video library, archiving a few important websites (one of my favourites is only now running on an unreliable mirror), backing up my audiobooks and the like. This will be going on the NAS I'm planning on building, and I'm still thinking about how I'll do large scale cold storage to back that up (probably more hard drives tbh), but for the moment the Japanese Verbatim 50GB BD-Rs offer a low cost of entry, reasonably affordable1 tertiary backup for my initial efforts (several external HDDs I already have will serve as a temporary secondary backup). I'm aware that they're not something I can just ignore for a decade before checking, but they do seem to be sufficiently robust to leave for several years rather than needed to check them once a year, and even then I can likely use a representative sample to keep track of potential issues.

The question I have is, what do people find is the most efficient drive for burning Blu Rays? Which drives handle dual (and triple, in case there's ever a sale of 100GB disks) best, with the fewest errors and failures to burn? Are there any programs you can recommend for checking and burning disks? Those of you with experience of making Blu Ray backups, do you have any advice or common mistakes I should avoid? Any advice is welcome.

1 ~$41 AUD/TB vs ~$25/TB for an 18TB recertified HDD, assuming only 80% of each is used). LTO7 currently runs to about $220 AUD/TB for the drive+free cartridge deal I've seen and obviously scales much better afterwards, while LTO5 is about as cost effective as the BD-R at the 80% use benchmark. Given the number of photo/video files I want to back up, my understanding is that it's unlikely to make use of the compression that would enable more favourable efficiency.