It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
6651
 
 
The original post: /r/datahoarder by /u/Hour-Rush9731 on 2024-09-10 16:46:46.

for example, google drive offers 15gb of storage for free just because you created an account. is this a good long-term storage plan for important files? this means i will have to manage a dozen accounts and mirror the same data on 2-3 accounts each.

edit: not only google drive, but for example mega, deegoo or similar other cloud storage solutions, which have 20gb of free storage per account

6652
 
 
The original post: /r/datahoarder by /u/Diego_Rdz_21 on 2024-09-10 14:52:11.

Hi Everyone

I need your wisdom, i currently use B2 to backup 2 Unraid servers with around 30TB of files (no business-related files) but keeping up with B2 maybe an issue pricewise in the long run. I can see that CrashPlan charges by user not by device getting backed up and also offers unlimited storage under the crashplan-professional offering .

Do you conder CrashPlan as a relievable platform? I'm thinking to change platforms as it may be cheaper as a backup solution for both server under single license with unlimited

6653
 
 
The original post: /r/datahoarder by /u/felicaamiko on 2024-09-10 15:45:22.

when i was 17 or 18 i took lots of photos. one day my hard drive acted strangely and i didn't think much of it. months later upon turning computer on i would hear a faint clicking noise and lost all the photos of my child hood. that is why i have external hard drives now. i still don't back up my stuff but i have so much junk that if a hard drive fails i won't be so sad.

what is your story?

6654
 
 
The original post: /r/datahoarder by /u/jdrch on 2024-09-10 13:05:44.

TL,DR: Volume Shadow Copy is the best Windows feature you're probably not using.


All my Windows PCs are backed up by Veeam Agent FREE for Windows to Veeam Backup & Replication Community Edition running on a Windows Pro for Workstations PC. The Veeam B&R repo lives on mirrored ReFS Storage Space on a Storage Pool on that same PC. That Storage Space is in turn backed up via SyncBack Free to a single NTFS HDD with daily Volume Shadow Copy snapshots performed via Windows Task Scheduler.

I recently performed an unsupported update from Windows 10 to Windows 11 on that PC. Due to what I suspect is a combination of a failing HDD, the update being unsupported, and me running the Release Preview channel, I believe the Storage Space was damaged, making that backup PC BSOD, so I pulled the bad HDD (didn't fix the BSODs), deleted the Storage Space, and rolled back to the Windows 11 Release Channel (fixed the BSODs).

The rollback involved mounting the Windows ISO as a virtual drive by double-clicking it. I seem to have mounted the ISO post-rollback to check something and then forgotten to unmount it. Unfortunately, because the Storage Space was deleted, the mounted ISO took its drive letter. This in turn meant that Syncback overwrote the NTFS backup drive with the mounted ISO's contents.

I discovered this NINE days after the fact (this morning), when I attached a new HDD to backup the contents of the NTFS drive to1 . After about 15 seconds of pure panic that I'd lost all my Veeam B&R backups, I remembered I have daily Volume Shadow Copy snapshots set up, so all I had to do was look at Previous Versions of the entire HDD in Windows Explorer (right-click -> Properties -> Previous Versions).

This brings up 2 fantastic benefits of NTFS VSC snapshots:

  1. They autorotate based on remaining storage, so they're set and forget
  2. You can open each Previous Version in its own File Explorer window

Thanks to #1 above and the fact that the total data on the 18 TB NFTS drive was 5.73 TB, I had 2 good snapshots remaining, including 1 made the day the overwrites started.

Thanks to #2 above, I didn't have to restore the 18 TB HDD 1st, use any CLI tools, or use any 3rd party apps. All I had to do was drag and drop the contents of the good snapshot to the new 24 TB HDD.

Problem solved!


Anyway, moral of the story: use VSC snapshots! They work on any NTFS or ReFS volume and make recovery super easy.

1 The NTFS drive will be repurposed to backfill the failed Storage Pool HDD

6655
 
 
The original post: /r/datahoarder by /u/theflyingepergne on 2024-09-10 12:53:18.

I've got a MyPassport 5TB HDD connected via USB which is currently fine but for my personal/work I've been filling it up at a rate of about 2TB a year and was thinking an easy solution to expand this would be to buy another MyPassport HDD, plug it into a high speed hub and then use StableBit to tell windows to treat the collection of drives as one virtual drive

But this is all in my head - are there any really bad reasons not to do this?

6656
 
 
The original post: /r/datahoarder by /u/weblscraper on 2024-09-10 11:14:20.

I’m not sure if this is the right sub or if there’s a better way to do this

I have about 5tb of courses downloaded, about many different topics but also a directory focused on IT and cybersecurity courses

If anyone is interested to trade kindly comment or dm me

6657
 
 
The original post: /r/datahoarder by /u/DatHotPotato on 2024-09-10 11:10:11.

Hi!

I currently have a NAS setup with two mirrored drives and an external harddrive the nas backs up to regularly. I have around 3TB of data that is important documents and family pictures videos.

My issue is that all of my data is in my apartment. So I have som parity if the devices should malfunction but none in a catastrophic event that destroys the devices at the same time.

I'm now looking into solutions for archiving this data and storing it off site, in my storage room or at my parents house. I want to avoid cloud solutions and recurring costs/subscriptions. Read and Write speed is of no importance either since this data will only be accessed if everything else goes to shit. Durability is probably the most important factor.

What would be the best way of achieving this kind of storage? Should I look at optical disk storage perhaps?

Thanks in advance!

6658
 
 
The original post: /r/datahoarder by /u/nebulnaskigxulo on 2024-09-10 09:59:26.

Hi all,

I'm shortly before the end of my studies and my Moodle account will be deactivated approximately 24 months after that. I would very much like to save all of the content (PDFs, videos, text etc.) available to me before that happens. Doing it by hand, whilst possible (and allowed), would be quite a chore. Considering the nature of this subreddit, I assume someone here faced a similar conundrum already. My question: Do you know of any good ways to do this automatically? The few dedicated browser plugins I've found so far don't really do a good job and the "download course" button of Moodle excludes all files over 100 MB (so, basically all videos).

Thanks in advance!

6659
 
 
The original post: /r/datahoarder by /u/SocietyTomorrow on 2024-09-10 09:36:45.

I dug around to see if anyone asked this before, and it doesn't look like it has. I've been wondering how much of a difference I could expect in terms of performance if I took my main zfs pool, driven by a quad-CPU Xeon E7 and 2TB of DDR3 RDIMMs, and swapped the guts out with something newer, 1-2 sockets but with DDR4? It does no other jobs than being a storage pool, serving out via iscsi and nfs, so I don't think CPU speed is all that important, I know RAM amount is, but what about the speed?

Edit: Added context that it currently has a total of 84 SAS2 drives between the main chassis and 2 JBODs, with room to spare (for now, I either need more RAM or... well, more RAM, but faster!)

6660
 
 
The original post: /r/datahoarder by /u/Hungry-Editor6066 on 2024-09-10 09:03:14.
6661
 
 
The original post: /r/datahoarder by /u/Bismarck_seas on 2024-09-10 08:01:40.

I am using a samsung dram less ssd (T7) that use slc cache to soeed up performance, things get written to slc first then write to the slower nand flash, but i am worried the slc flash could wear out from continuous writing to the drive before the main nand cells get significant wear, how durable are ssd for continuous read writing operations?

6662
 
 
The original post: /r/datahoarder by /u/Artistic-Quarter9075 on 2024-09-10 06:59:41.

Hi all,

Last week, archive.is and other TLD extensions went down. They came back up after a day, but since yesterday, I've been having the exact same issue. Does anyone know what's going on?

6663
 
 
The original post: /r/datahoarder by /u/phospholipid77 on 2024-09-09 23:24:45.

I'm honing in on a couple of backup solutions for our situation. Before I commit, I want to get some of your ideas. What would you pick or what would you consider in this situation:

We have one NAS (A) with about 160TiB of data. We have another 200T NAS (B) empty and waiting to receive backups. NAS A is TrueNAS and NAS B is QNAP (and I cannot install TrueNAS on that because of the chip). We have a 10G-baseT intranet, and we would like the backups to capitalize on that as much as possible. We want the first backup to go as quickly as possible (realizing it could take some weeks). There is a system that sits in the room with an i7-9700KF processor and 64G of RAM running both Ubuntu and Windows 11.

Given this setup, what would you pick? What direction would you go?

I think I'm near a solution but I would love your insights. I was running Arq from a Mac and it was just... disappointing.

Any support, ideas, or concerns are appreciated. Cheers!

6664
 
 
The original post: /r/datahoarder by /u/Agitated-Farmer-4082 on 2024-09-10 05:21:34.

The product works great but I am broke. Orignally I wanted to combine 3 drives into one big drive but trying to setup raid on windows just didn't work for me so I used stablebit and it works great so far but Im running the 30 day trial. I have 3 drives, 30 gb each so with stable bit I made a combined drive that is 90 ish gb and it works perfectly but I just need a free alternative.

https://preview.redd.it/4akinnil2xnd1.png?width=1377&format=png&auto=webp&s=2869066a64839eb7489c48c76107455433bf16e0

https://preview.redd.it/7fjwpj3o2xnd1.png?width=405&format=png&auto=webp&s=dd989f52fb148804d62f13f3670f326a6a15f3b5

6665
 
 
The original post: /r/datahoarder by /u/MeetTheReal007 on 2024-09-10 04:52:03.

I need to add the same intro and outro to hundreds of mp4 files.

is there any cloud based tool that can do this?

6666
 
 
The original post: /r/datahoarder by /u/SeaSlug88 on 2024-09-10 04:19:40.

I’m new to data-hoarding and while I know a NAS is a must have and cloud storage is severely limited, I still need to move things via the internet from time to time, so I was wondering what you guys use for Cloud Storage?

6667
 
 
The original post: /r/datahoarder by /u/tahiro86j on 2024-09-10 04:07:53.

The title says it all.

I am not one of them (although I wish I were) but those who’ve been DJs themselves with names somewhat known and respected in venues (local or otherwise) for 15yrs+ typically have lots of CD-R/RW written as CD-DA.

Such disks are typically obtained by the DJs from artists/producers who would give them out for promotional purposes to DJs that they trust and often contain tracks that are not intended to be released.

So, no substitution exists for the tracks found on most of such disks.

Today, except for special occasions, DJs prefer to show up at the venues with one or two USB thumb drives containing tracks for the night.

The trend is said to have started around 2009 when PioneerDJ released CDJ-2000 (which along with two later variants became the industrial standard models in venues and festivals).

Further shifting DJs away from disks to chips, additionally, are the presence of decks that no longer include CD-DA playbacks (e.g. CDJ-3000).

So, labeling and organizing thousands tracks ripped off of such disks is an essential part of the job preparation as a DJ today.

You would need lots of drives to facilitate the process of importing thousands of such old/only-to-be-heard-in-clubs tracks, wouldn’t you?

6668
 
 
The original post: /r/datahoarder by /u/Total_Decision123 on 2024-09-10 01:10:27.

Long time lurker, I’m still a ways away from data hoarding myself but the archival of important/interesting information, photos, videos, etc has always been interesting to me

That leads to my question: What’s some of the rarest content you own? As in niche websites you logged that were taken down sometime ago, hard to find photos/videos of important events, even unseen photos/videos that only you and a handful of others have seen

Curious to hear!

Also side question: Do you store the said “rare data” separately or is it all mixed in with other data?

6669
 
 
The original post: /r/datahoarder by /u/miltonsibanda on 2024-09-09 23:51:52.

This is a question for the UK hoarders out there. Where are you guys finding affordable drives? Or are you all rich? I haven't bought a new high capacity drive in what feels like years. But I've now decided to get a usb-c DAS enclosure to replace my creaky old server and save some electricity.

6670
 
 
The original post: /r/datahoarder by /u/mooseman77 on 2024-09-09 23:25:10.

🇨🇭🇴🇴🇸🇪 🇾🇴🇺🇷 🇦🇩🇻🇪🇳🇹🇺🇷🇪

I'm leaning towards 2.2

Background: you have a single 2 bay WD Nas you got from a friend and an little windows arr server machine. You have a small budget to buy the drives to fill your NAS (~$200)

Which do you choose:

  1. Buy 2x 4 TB (Iron Wolf) HDDs
    1. Raid 1
    2. Raid 0
  2. Buy 2x 12 TB (BarraCuda Pro REFURBISHED) HDDs
    1. Raid 1
    2. Raid 0
  3. Buy 2x 12 TB (Exos REFURBISHED) HDDs
    1. Raid 1
    2. Raid 0
  4. Look for a different brand other than Seagate
  5. Buy 2x 16 TB (Used) HDDs
    1. Raid 1
    2. Raid 0 (ಠ_ಠ)
  6. Wait till you have more money to buy bigger/better HDDs
  7. Wait till you have enough money to buy a NAS with more bays
6671
 
 
The original post: /r/datahoarder by /u/atomic92 on 2024-09-09 23:21:39.

One of my older 8tb drives died over the weekend. Not bad for almost 8 years of use.

The rest of my array is all 14tb drives (including parity) 2 - 10tb and 1 (was 2) 8tb drives.

Not sure if I should buy a couple of 16 or 20tb drives to upgrade the parity drives and then use the 14’s in the array or just buy a couple 14tb drives for direct replacement.

I’m only at 64% usage of 106tb but always felt if I needed to install a new drive. I might as well upgrade at the same time.

nvm.... ordered 6 - 18tb drives from SPD.

6672
 
 
The original post: /r/datahoarder by /u/OGSyedIsEverywhere on 2024-09-09 22:26:32.
6673
 
 
The original post: /r/datahoarder by /u/Apptryiguess on 2024-09-09 21:32:44.

https://preview.redd.it/68awvr84qund1.png?width=686&format=png&auto=webp&s=78a05c03b253eae9ee89c3e3422432f8d572b415

https://preview.redd.it/hqdgps84qund1.png?width=995&format=png&auto=webp&s=a453f6b0d591a5798155b2a2a68b611928659082

Drive G according to Windows is 77% fragmented. The drives advertised transfer speed is 285 MB/s, I get around 240 MB/s as you can see. In no way do I need a defrag, but should I do one anyways? Idk, I usually disable the standard Windows defrag immediately when I get a new drive and only defrag it once its around 80% full and then fully fill it up to "never" change any data on it ever again. I use this drive a little differently though (every day use) and so am wondering if there is any benefit to defragging it right now?

6674
 
 
The original post: /r/datahoarder by /u/Vagaborg on 2024-09-09 21:21:03.

I have an Arch Linux media server setup with a 4-bay DAS containing one 4TB drive and a Windows PC with two additional 4TB drives. I’m looking for a method to automatically back up all three drives, preferably with daily snapshots or similar. I've got a 16TB drive in the post and will stick that in the DAS

What tools or methods would you recommend for setting up automated backups in this environment? My drives are ext4.

6675
 
 
The original post: /r/datahoarder by /u/wooable on 2024-09-09 20:53:15.

Hi I wanted to know if it is possible to transfer the 5 hard drives in a 5-bay DAS that are in a software raid to another 5-bay DAS and still maintain all the contents in that same software raid.  

 

I've been having some reliability issues with my Orico 5-bay enclosure (ORICO-3559C3) and would like to switch over to say a more reliable TerraMaster D5-300 5-Bay or QNAP TL-D800C 8-Bay enclosure.  

 

The software raid is Windows Storage Spaces with REFS Filesystem and Parity Resiliency type.  

 

Drives are 5 Exos X20 20tb drives.

 

If it's not possible with Windows Storage Spaces is there another software raid that would allow me to do this in the future?  

 

Sorry if this is a dumb question. I did some googling and couldn't find a definitive answer. Thank you for all your help I really appreciate it!

view more: ‹ prev next ›