It's A Digital Disease!

The original post: /r/datahoarder by /u/Awesome-Fossum on 2024-11-27 00:08:13.

I am sitting here trying to figure out where to move my off-site backup now that my parents are moving out of their house. The thought crossed my mind that it would be nice if there was a service where I could put my encrypted data in a pool of peer2peer data distributed across various sites. Given this reddit has a lot of people with large data stores, I wondered if anyone else thought of a similar solution?

Points:

• Something like you can put in a third of what you backup for others.
• It would need to be more than a single fail-over for nodes that go offline.
• Each user would have to have unlimited data cap (although bandwidth likely wouldn't be an issue)

Other thoughts?

The original post: /r/datahoarder by /u/Joyride84 on 2024-11-26 23:20:24.

Hi, I'm thinking of installing a PCIe SATA expansion card (such as the LSI 9207-8i) in a new TrueNAS build. (I know...it's a bottleneck.) Can/should I connect the host OS drive to that card, so that one more storage drive can connect directly to the motherboard? Or does it not initialize soon enough during boot, for that to work? Or for that matter, is this a horrible idea for some other reason?

I have some SATA headers on the motherboard, but not quite enough. My thinking is that if I must introduce the bottleneck of an expansion card, at least the OS drive should experience less throughput than a storage drive, during heavy read/write operations. Is that reasonable? Or do I have no idea what I'm talking about?

Thanks!

Edit: Typo

The original post: /r/datahoarder by /u/varignet on 2024-11-26 23:07:52.

Hi, I just received a new WD_BLACK D10 12Tb mounting the HC520 HGST HUH721212ALE604 .

I noticed that transfer speeds drop quite a lot when adding data to the disk.

Also, my read speeds are always slower than my write speeds but reviews online from 2020 always show matching read/write speeds.

Is this normal or should I request a replacement?

When empty, the disk ATTO writes/reads are 245Mb/s - 242Mb/s

After having added 2Tb of data to it, my writes/reads dropped to 224Mb/s - 212Mb/s (see the slower read speeds)

When doing a full surface scan, I noticed that the speeds started at 230MB/s and dropped to 179Mb/s at 3Tb, 173Mb/s at 6Tb and 120Mb/s on the last Terabyte. Is such speed deterioration normal?

The original post: /r/datahoarder by /u/Magic_Neil on 2024-11-26 22:56:53.

I've been reading on SAS expanders, and the documentation everywhere is pretty consistent, in their function, and I found a great diagram:

https://preview.redd.it/5wsn7ol1cb3e1.png?width=797&format=png&auto=webp&s=b0c1466eae25325a4ee56954e156668732b85af4

But there's something I'm not really clear on, which is the exact function of the connection between the expander and the HBA; the link between the SAS expander and HBA is described like a network switch, but is it switching based on the available bandwidth in aggregate, or is it individual lanes? In the above example it's 8x1.2GB/s links, so does that mean it's got 9.6GB/s of available bandwidth to divide however it needs to (not unlike a 10gb/s uplink on a gig switch) or is it 8 1.2GB/s paths that are multiplexed to the drives as needed?

The difference I see here is that if it's an "uplink" of sorts where it's just using it for bandwidth it doesn't really matter, since it's such a massive pipe. But in a situation where it's "paths" and there are more active simultaneous disks than there are paths, it's oversubscribed and there could be performance limitations since I wouldn't expect the expander doesn't buffer data. That is to say, an HBA with 48 devices behind it screaming at once would be queued to "talk" 8 at a time.

The original post: /r/datahoarder by /u/15Veggietales on 2024-11-26 21:47:20.

https://nij.ojp.gov/topics/articles/forensic-databases-paint-shoe-prints-and-beyond is a quick glimpse of the sorts of databases I'm discussing - but most of you probably understand.

I'm not sure if I'm daydreaming a freeware open-source way for victims and investigators to use it themselves, or just a gigantic repository of the info backed-up in a dozen EMP-proof places to prevent total collapse and rebuild...not sure I care.

I did a quick glimpse on here and didn't see anything - now obviously most of these databases are either proprietary or at the very least internal - but it doesn't seem illegal (well, Aaron Swartz's persecutors might disagree)...anyways, just a casual thought that came to mind.

The original post: /r/datahoarder by /u/KingCallum11 on 2024-11-26 19:51:11.

I've been watching Task Manager while my hard drive does stuff like when I'm reciving data while torrenting, when I'm ripping bluray files, ect, and it seems to be sometimes hitting 500ms response times (usually under 75 most of the time), explorer seems to stop responding sometimes, MakeMKV seems to drop to X0.1 speeds and then go back up to X6.5 speeds.

Is this a sign of my hard drive kicking the bucket? I've had it for a few years, and I honestly can't afford to replace it or back it up to another drive right this moment.

Typically, I'm working with multi-gigabyte files... Bluray rips, or whole series of shows. I currently have 3.3TB of Media stored on it, and it would suck to loose years of collecting

For context I'm using a Seagate BarraCuda 6 TB (ST6000DM003-2CY186), which states GOOD in CrystalDiskMark. I use a Fanxiang S101 2TB SSD as well, which also states GOOD with a 100%, although the HDD doesn't say a health percentage.

Should I be torrenting or doing intensive tasks to an SSD and copying over to store? Ripping to my SSD, renaming in FileBot and then copy over to store on my HDD? Should I take extra precausions to ensure it doesn't die before I can afford to get another or a bigger drive?

Thanks for any advice!

The original post: /r/datahoarder by /u/One_Tap_ on 2024-11-26 19:26:28.

Hey everyone,

I’m in a bit of a bind here and need some advice. I have a massive amount of data (over 200GB) on my iPhone that needs to be backed up to iCloud. The iCloud backup process has been an absolute nightmare – I tried backing it up overnight, but when I checked in the morning, it still said “4 hours remaining.” I waited another hour and still saw the same message. It’s driving me crazy, and I’m sure I’m not the only one who’s had this issue.

At this point, I’m losing patience with Apple and the whole iCloud process. I know the “Download” feature from iCloud has a 1000-photo limit, which feels totally inadequate, and I’ve tried using the iCloud app from the Microsoft Store, but it’s super inconsistent. I’ve also considered using Wi-Fi transfer tools like Intel Unison, but I’m left wondering if it’s pulling data from the iPhone’s physical storage or just the iCloud-synced storage.

I need a reliable way to completely extract all my data (including photos, videos, apps, and other data) from my iPhone to a Windows PC. This is where iMazing caught my attention. It looks like a safe solution, but I’m not sure if it’s worth the price or which plan to go for. Does anyone have experience with iMazing?

I see two plans: • Personal Device License (1 Device) • Personal Subscription (3 Devices)

Since I’m backing up a large amount of data and may need to restore it to multiple devices down the line, I’m wondering which plan would be best suited for me.

If you’ve used iMazing or any other reliable and safe software solution to extract data from an iPhone to a Windows PC, please let me know your experiences and recommendations. I don’t want to waste money on a tool that’ll only cause more frustration.

Apologies if this is a repetitive post, but I could really use some help with this!

Thanks!

The original post: /r/datahoarder by /u/ookerberry on 2024-11-26 19:23:09.

Hi Folks, I'd like some help please.

I just purchased a Broadcom SAS 9305-24i HBA, and it is running really hot. With just case cooling (3x120mm + 2x80mm fans) it was going over 100°C. I added This shroud (https://www.thingiverse.com/thing:6567902) and a 13kRPM, 24CFM 40mm fan, and it still is getting up to a stable 73°C. Broadcom recommends an operating temp of 55°C to 65°C.

Do I have a bad board, or do others with a 9305-24i see crazy high temps?

The original post: /r/datahoarder by /u/earvinexes on 2024-11-26 18:33:44.

2 Months Ago, Archive.org have taken down a whole bunch of Dumped Arcade PC Games a.k.a. Teknoparrot ROMs with a huge size of almost 800 GB. Rumors are Malware on most games, Some are DMCA'd and never been preserved.

The original post: /r/datahoarder by /u/whatarewedoing23 on 2024-11-26 16:10:12.

I'm looking for a free software solution to automatically create regular backups of my C drive to an SMB share that supports file versioning and incremental backups.

I see Veeam get recommended a lot, and maybe I just haven't tried the right version but I can't seem to get it to work. One version was complex and seemed unable to backup the actual computer it was installed on, and the other was simple but did not allow backup to SMB shared drives.

I've seen recommendations for various other programs as well, but any I've found that support backup to SMB drives don't seen to have file versioning (so that I could choose between restoring to yesterday, last week, last month, etc.).

Are there any free programs that do all of these?

Edit: Backing up the entire drive would be ideal, but a file/folder level backup with the rest of these features would be better than missing one of the other features.

The original post: /r/datahoarder by /u/SynergyPulse on 2024-11-26 11:11:34.

I've just bought a 8tb HDD and wanted to use it in RAID0 with my curret 8tb HDD which is full of data. I realized that is not possible without formatting and data loss (don't have storage to back up my old HDD). I changed my mind and would like to just combine the two HDDs into one volume without having to move the data I already have on my old HDD. Is this possible without paid third party software?

I'll be using this volume as my Plex storage and will be just playing off the HDD (mostly only one user local playback) and seeding as I'm getting my movies from PTs.

The original post: /r/datahoarder by /u/Tr3nt_ on 2024-11-26 09:47:52.

My school uses student google accounts, but they delete them when we graduate. I'd like to keep my work I did on it (mainly just the stuff in drive). I there an easy way to back this all up onto a hard drive? Thanks.

The original post: /r/datahoarder by /u/Milkassassin34 on 2024-11-26 17:08:49.

I was looking around trying to see if the Seagate BarraCuda 8TB was any good for storing videos. Most old posts I found had people asking in relation to setting servers up and things of that sort, but I would only be using it to store video clips. I'm open to other suggestions if people prefer others, but I was only looking at this one because I constantly see it on sale for around $100 which seems very enticing

The original post: /r/datahoarder by /u/jul059 on 2024-11-26 16:34:47.

I'm building a small TrueNAS system with 3 drives, is there a downside (except $) to buying an extra identical drive right now and letting it sit (probably for years) before I need to use it? The only reason I'm considering doing that is to mitigate problems with possible product discontinuation. Or is product discontinuation not an issue? (can I use any non-identical drive with the same capacity?)

The original post: /r/datahoarder by /u/Bullynine on 2024-11-26 15:45:52.

I like to update my PC HDD every few years. I have two 2TB drives: a Seagate Barracuda with 19018 hours on the clock and a Toshiba P300 with 34467 hours. It seems a no-brainer to update the Toshiba, but the Seagate has worked MUCH harder; I use it with QBT for P2P file-sharing, whereas the Toshiba is solely for storage and occasional playing of downloaded videos. Which one should i replace?

The original post: /r/datahoarder by /u/TGRubilex on 2024-11-26 14:45:37.

Im located in Canada and I'm looking for 20TB drives for a media center (I'm sick of stacking 1TB recycling bin laptop drives on pcie sata cards like a lunatic). Im seeing 2 really good deals right now. On severpartdeals I can get a 20TB recertified Seagate exos drive for 329 cad, or for 350 cad I can get one of those wd easystore external drives and shuck it.

If I do go for the WD and shuck, is it going to be as simple as pulling out the drive and sliding it into my SATA backplane? Or am I gonna need to do some jank to get it working? Because the Seagate are cheaper and still have 2 year warranties so I'm very tempted.

This will be going into a raidz1 array btw.

Anyways just some advice/opinions would be nice before I spend this much money.

The original post: /r/datahoarder by /u/Puzzleheaded_Meat999 on 2024-11-26 12:08:11.

The original post: /r/datahoarder by /u/UsedToBeaRaider on 2024-11-26 11:37:52.

https://imgur.com/ufjkUMK

Hi all,

I'll start with I know my setup is... a choice. I've been piecemealing a lab with what I can from a local auction site, so I get what I get.

I've got two NAS (Terramaster running TrueNAS and Synology), a 10 TB Lacie drive, the DAS to the right (No drives yet, but esata/usb3, hardware RAID), and a Time Capsule not pictured for Mac backups.

I originally got the Lacie to backup the Synology before I got the Terramaster. I'm slowly transferring files and containers from the Synology to the Terramaster, then they'll backup to each other (hopefully one moved offsite). I plan to Frankenstein an actual server together so my NAS can just be a NAS. Now that I have the DAS, it can also be redundant for backups and extra storage. I don't see a home for the Lacie now.

So, what's a good idea for the Lacie drive? Should I shuck it? Am I thinking too small and there's a great use I'm not seeing? Just sell it and get drives for the DAS? thank you!

The original post: /r/datahoarder by /u/njlee2016 on 2024-10-13 17:13:50.

I'm looking for advice on how to consolidate duplicate files and folders on my NAS. I had a bunch of external hard drives and USB sticks. I moved all of that data to a Synology NAS. Some of the data is the same. I'm looking for an efficient way to remove the duplicates. I'm also interested in an efficient way to organize the data once the duplicates are removed.

The original post: /r/datahoarder by /u/awkwardpotatocat1758 on 2024-10-13 17:04:49.

cheaper the better but i still want something good

The original post: /r/datahoarder by /u/MericaFTWs on 2024-10-13 17:04:05.

I currently have a 2 bay NAS with a total of 10 Tb of usable space and about 4 Tb free at the moment. The 2 drives are a 4tb and 8tb WD red.

I currently make a copy of all the data from the NAS to a 10 Tb WD red in a separate PC that's on most of the time.

I want to expand my Plex server since I'm no longer wanting to spend time and resources using handbrake to compress files. The mkv files are much larger in size but SO much faster and easier to do.

I have a 4tb WD red in an external harddrive bay connected via USB to my miniPC that is completely free of data.

My question is... since I've made the switch from handbraking everything to raw mkv, my storage is filling up fast and by my estimations it will be full by the end of the month. Since my MiniPC has the plex server it can detect external drives nicely.

Should I buy a 4 bay DAS and continue from there since it's cheaper than a NAS or break the bank and get a NAS (It's about a 700 dollar difference from the ones I want, not including drives).

As for backup i was going to buy some cheap seagate or WD blues at 8tb a piece.

Thanks for any and all recommendations. This community is amazing.

The original post: /r/datahoarder by /u/denierCZ on 2024-10-13 15:14:29.

The original post: /r/datahoarder by /u/ilt1 on 2024-10-13 15:06:30.

I have so much things I saved on Twitter and Instagram I would like to revisit later and have a central place for this. Is there an app for this?there used to be some automating apps such as itff(?) or similar. Something that periodically scrapes my favorites and likes on these websites and send it to me as an email. That could work but also what could work is to display it on their 3rd party site. Any ideas?

The original post: /r/datahoarder by /u/wPoLrAdY on 2024-10-13 15:01:01.

I want to archive shroomery's forums. Any idea where to start? Or if you know of a place where it's already been done. Any advice would be appreciated.

The original post: /r/datahoarder by /u/icky_dodo on 2024-10-13 14:41:15.

20TB on each. In one location the directories are organized. In the other location it's all over the place. Is there a way to ID the files on both drives, organize the target location according to the source, and sync files from the source that aren't present on the target?

If I can avoid wiping the target and simply recopying everything, it would save me some heartburn.

I use FreeFileSync for my backups. Win 11.