It's A Digital Disease!

The original post: /r/datahoarder by /u/dancole42 on 2024-08-24 00:51:39.

Beginner question here... I have a Windows 11 laptop and Windows 10 desktop on the same network. The Windows 10 desktop regularly backs up to Backblaze.

For the laptop, which is used for photo editing, I do not care about imaging the drive. I just want to back up my photos and some CaptureOne photo editing settings.

Is there a simple way to regularly back up just the specific folders I need over my network from the laptop to the desktop?

Thanks!

The original post: /r/datahoarder by /u/dazza555 on 2024-08-24 00:49:06.

So I'm quickly running out of storage as I convert all my discs to digital for the HTPC. Currently I have an old laptop connected to the big screen and a couple of 4TB external HDD occupying all the available ports. After doing the math I figure I'll need a minimum of 24TB to fit what I currently own. Since I'm not made of money I was wondering if I purchased this enclosure and 3 8TB drives to start with will that work? Later, as my collection expands can I just drop in another drive? Lastly what about mixing and matching drive capacities like 1 16TB drive with my original 3 8TB, will that work?

Might be worth noting my current laptop supports USB A 2.0 only but I am upgrading in the next 6-12 months and that PC will have USB C ports and I want this drive setup to work with the upgrade.

The original post: /r/datahoarder by /u/Steady_Ri0t on 2024-08-23 23:27:19.

I found a dump of about 3000 photos that I'd like to download. JDownloader and WFDownloader don't find more than 150. I tried a random program I found called Octoparse that I thought successfully pulled links to all of the photos, but when I started downloading the images they were all thumbnail size.

Does anyone know of a tool or method that'll pull full resolution photos from Lensdump?

The original post: /r/datahoarder by /u/red_runner_23 on 2024-08-23 22:22:30.

I want to access to view or download ~25 sweater vest images on this clothing site across 16 different snapshots of it within the past 5 years (to view all previous releases of sweaters in their seasonal collections).

I was only aware of the wayback machine to do this, however, it is extremely slow (will either only show 2 images and the rest missing after 20 minutes or just not load anything).

Does anyone have any ideas on APIs, scripting approaches, or other sites I can do this with? (I am able to code in python, so I could hack an existing script if anyone has one relevant to this use.)

The original post: /r/datahoarder by /u/RamityCamity on 2024-08-23 22:08:11.

Really just wondering if there's a perc card that can support 45 drives at once?

I have been looking around but didn't see much past the h200 or the h700 which seem like they really don't support the quantity of drives I'm looking for.

Can I use an lsi card in the expansion card slot without issue?

The original post: /r/datahoarder by /u/genuinetickling on 2024-08-23 22:02:59.

Hello guys,

1 - I have a diy nas already based on a Mac Mini connected to backblaze

2- it's a 2-1 solution, and I want a local backup now to minimize downtime

3- Was going to go for a syno 5 bays, but it looks like I have to pay 50 % more than I should and they have weird policies with hard drives going on.

So here is where I'm going to :

Unraid (so that I can re-use hard drives)

ECC Memory

10 gb ethernet (maybe I will use for video editing)

2 nvme slot for caching

8 bays is my sweetspot

I have no need of graphic cards or transcoding as plex is on the Macmini and I direct play anyway

The problem is the case, I almost want to scrap the project and go to syno just because I cannot find something appropriate. I want something horizontal, I don't need too compact but it cannot be too high

Node 804 - Not easily available for me, but I would like something similar

The original post: /r/datahoarder by /u/Wilson1218 on 2024-08-23 21:33:31.

I intend to set up a NAS using high-capacity 3.5in SATA drives in some form of enclosure connected to my Lenovo M720Q. Currently I have Proxmox running on a 2.5in 256GB SATA SSD and I intend to add a 2TB M.2 NVMe SSD for running VMs/containers.

Since I likely don't want to use USB to connect the enclosure, I was considering adding a PCIe card (which unfortunately requires a proprietary riser but oh well) that allows a better type of connection. Regarding this, I have a few questions:

1. What type of connection would be ideal? I was considering a PCIe HBA with two SAS connections, allowing four SATA drives each. Other options I have seen are eSATA ports and mini-SAS.
2. Do you have any suggestions regarding good enclosures for the drives?
3. Since a PCIe card would take up the space of the current 2.5in SATA SSD, if the enclosure I get is compatible would there be any practical difference in using said SSD to run Proxmox whilst in the enclosure (with the 3.5in drives in the enclosure's other slots)?

Thank you!

The original post: /r/datahoarder by /u/HB20_ on 2024-08-23 20:52:47.

The prices for 20TB HDDs at ServerPartDeals are approximately $220 ($11/TB). Should I wait until Black Friday to buy? I don't know much about the HDD market to determine if this is their regular price or what discounts they might offer.

The original post: /r/datahoarder by /u/Outrageous_Pie_988 on 2024-08-23 20:06:15.

I'm relativly new to this data hording but none the less I'm looking to eventually have 24-36 drives... What is the best way to connect all of these to a single consumer grade PC?

The original post: /r/datahoarder by /u/Iwywnsb on 2024-08-23 19:01:42.

Hi everyone,

I just learned about data scrubbing on my Synology NAS and it's importance to avoid bitrot, so I have scheduled to do it every 3 months. Now I'm wondering if it's possible to do it in Windows 10 too, since my NAS is also my backup for my PC files, and I would like to keep my files in Windows bitrot free. Is it possible?

Thank you!

The original post: /r/datahoarder by /u/HB20_ on 2024-08-23 16:50:56.

Hello, I'm thinking about upgrading the storage on my server and I'm unsure which of these two hard drives would be better to import:

Option 1:

• Name: Seagate IronWolf Pro ST18000NE000 18TB 7.2K RPM SATA 6Gb/s 512e 3.5in Recertified Hard Drive
• Value: $179.99

Option 2:

• Name: Seagate Exos X20 ST18000NM003D 18TB 7.2K RPM SATA 6Gb/s 3.5in Recertified Hard Drive
• Value: $179.79

A bit of context, my server is currently located in my office and I mainly use it for media storage.

Additionally, do you think it’s worth waiting for Black Friday or another promotional event? I'm planning to buy two units, but since I'm in Brazil, any discount in dollars is very advantageous.

The original post: /r/datahoarder by /u/downsouth316 on 2024-08-23 16:27:37.

I am a longtime fan of SciFi. I was tired of not having something to watch. I decided to obtain all SciFi series from the last 20 years. It has been an interesting & amazing journey. I go for the highest quality possible BluRay Remuxes then go down from there based on the highest quality available. Some things have never been commercially released so if a lot of people haven’t capped it, it’s very hard to find. Example: Powers 2004 UK Series, still looking for that one. Anyway I have about 310 SciFi TV Series so far. I load them up on 24TB Seagate IronWolfs into my Zidoo UHD 8000 Media Player. It’s like Netflix on Steroids, the beautiful Poster Wall is amazing! I have a backup of each hdd in my Sabrent 10 Bay. The first 24TB is full, the second has 22TB free, once I max that out, I will get another Sabrent 10 Bay to finish the TV Series & to start the Sci Fi Movie Archive, 40-70 Sci Fi movies have come out each year based on 2023/2024. The best part is no forced trailers playing by Netflix/Other Streaming Services, no silly recommendations of shows you won’t like and max video quality since it’s not streaming :) One of the other good feelings is when I buy a DVD or BluRay set, rip it with MakeMKV then replace my lower quality copies with max quality. Some dvdrips are like 200-350 mbs an episode but the dvdremux is like 1 gig per episode. Anyway have you archived any Sci Fi or 1 genre or any combination of TV/Movies?

The original post: /r/datahoarder by /u/ZiggyJambu on 2024-08-23 15:43:00.

I bought 2 external HD in 2020 from Costco that both started acting up a few weeks back. I was unable to correct the reading error and after a prolonged process with Seagate they have replaced the hard drives for me. I think I may have received a refurbished one, but what can I do?

Having said that, I had transferred all of my music onto the 2 TB drive (including all of my CD collection and digital downloads) and all of my photographs since 2004 onto my 5 TB drive. I am an amateur photographer and for example took over 15,000 pictures on my last two vacations overseas. My PC could not handle all of this and now that I am retired, I do most of my computer work on my laptop.

It would seem that even if I do not touch these, there will be a problem just because they age. If this is the main reason for failure, rather than amount of use then if I buy additional hard drives now and do not touch these (Back up for my back up) then that seems like a waste of time and money as I should expect these to fail over time as well.

So, what do you do? Do you just automatically buy new hard drives every 2-3 years? Do you just hope that things hold up? I really want to preserve many of the pictures if not all. I have separate smaller files of my favorites but even that becomes an issue for where they are stored.

Thanks for help.

Finally, I have found over time that even when I pay more for QUALITY brands, it still becomes a 50/50 bet that things will go fine. I learned for example that refrigerators fail 70-80% in the first year regardless of brand. It is cheaper and easier for the companies to repair those that breakdown than to fix it at the production level.

The original post: /r/datahoarder by /u/maximumkush on 2024-08-23 14:47:02.

I’ve tried a few… but they all crash out or doesn’t grab lyrics from popular songs

The original post: /r/datahoarder by /u/Xenonnnnnnnnn on 2024-08-23 14:40:10.

The original post: /r/datahoarder by /u/Skinny_Dan on 2024-08-23 14:37:31.

I'm looking for more drives to fill out my JBOD enclosure. I've heard it recommended several times that a good general rule to avoid simultaneous multi-disk failure is to space out when you buy your drives. I assume that this advice is operating under the assumption of brand new drives. (I could be totally wrong in that assumption.)

But what if I'm buying manufacturer recertified drives from somewhere like ServerPartDeals? Should I still avoid buying a bunch of drives at once? Or does the fact that they're used drives, potentially from different batches and with different histories, mean that practice is pointless?

The original post: /r/datahoarder by /u/killinbylove on 2024-08-23 14:01:12.

The original post: /r/datahoarder by /u/Powablocks on 2024-08-23 11:22:50.

Hello,

I'm thinking of doing a NAS with unraid and would like to buy 3 hard drive to start. I'm located in France so don't have access to ServerPartDeal or GoHardDrive with easy warranty. I'm thinking of buying this hard drives (https://www.amazon.fr/gp/product/B0CFBF7SV8**)****) and adding the 4 years amazon warranty on top.

What do you think of that ? Is there better deals in EU ?

The original post: /r/datahoarder by /u/Deviousless on 2024-08-23 11:17:19.

Using Macrium Reflect yesterday to clone a large hard drive from a failing hard drive to a new one. After the process completed, the log says that it completed perfectly fine without any issues.

After checking, yes the partition it copied was exactly the same size but the size of data it copied over was different by a substantial margin. On the original drive it was a 4tb partition (3.63tb really) with an amount of 545gb free, on the new drive after everything finished it has about 440gb free. Which is about a 95gb size increase.

Originally I thought it might have some sort of additional partition in case the clone failed at some point to start back up but there’s no such thing I can see in the Windows 10 Disk Manager.

Any ideas why or if I should be worried or where that data increase came from?

The original post: /r/datahoarder by /u/muehli_94 on 2024-08-23 09:46:06.

On the shoulders of giants, we stand tall,

Data hoarders and hosts, we heed the call.

With servers humming and storage vast,

We treasure the present, archive the past.

But in the shadows, behind the scenes,

Are the devs who crafted our digital dreams.

Their lines of code, so precise and neat,

Lay the foundation beneath our feet.

For every byte we save, every server we start,

Their work is the core, the beating heart.

In this digital realm, where we thrive and play,

We honor the giants who paved the way.

Thank you to all the devs of the tools I use! You are heros.

The original post: /r/datahoarder by /u/InternalOcelot2855 on 2024-08-23 09:10:40.

Doing some debating, ATM.

Option 1 is spending 4K or so on a 45 drives unit. Shipped from Canada from my understanding

option 2 is a few 24 drive cases and multiple NAS units, guess the benefits of spreading the data will help with speeds.

Going with option 2 the cheapest I have found with shipping is AliExpress. Where are fellow Canadians getting their NAS cases?

The original post: /r/datahoarder by /u/taddy-vinda on 2024-08-23 05:42:31.

So I have a 4x 8tb in raid 10 that is my main back up and storage. And I have a movies library (4K hdr-10 7.2 audio) each about 80gb each. Problem I am having is my media center pc when playing from the array just buffer like every 10s (only have 1gpbs network)

So I have about 6 2tb wd black drives from an old setup raid 0 array with all 6 giving me about 10.7tb of very fast access to movies in the media center (raid 10 array is only used as crash recovery) Honestly that raid setup been running for ever without any issues at all for being a raid 0. Feel like a wasted space on the main backup.

My question is is there any possible way that I can add 4 more 2tb drives to the rain 0 without having to re copy from the backup. (Will take for freaking ever)

Second question is it possible to add bigger capacity drives instead of 2tb like 4 or 8 tb without loosing space from the drives to the raid 0 array. Like splitting drives to multiple 2 tb drives and adding em to the array etc.

(These are movies. I can recover if I loose it all SLOWLY over time) aka non critical data all I need is speed.

Update

I added the new drives made em a spanned drive in windows disk manager. (Yuk I know it’s cringe) Copied the old files on to the new volume. Deleted the raid 0. Diskpart clean the old drives. Added them to the span. Now I have one hell of a massive movies library.

Before you all get mad. Yes I know I loose one all gone. (Bruh they are movies and are backed up on the main backup) Yes I know I don’t even get the speed advantage of a raid 0 whilst being volatile.

Although I want to say it’s a temporary setup knowing me I won’t change until it fails. That’s what I said last time when I set up the raid 0. It worked so well so far for years.

When this fails or the back up fails I’ll get a new nas and upgrade the network properly.

I just didn’t want to copy files for days or spend any money.

Old raid 0 preservation method are still used like The movies are downloaded first to a small 240gb ssd with dram cache from torrents and other. So it doesn’t constantly writing to the array. Most time drives are only accessed 3 max or less times a day for watching a movie, Back up and coping a completed download to the array from the small ssd. Rest of the time inactive and parked.

The original post: /r/datahoarder by /u/massivlybored on 2024-08-23 04:56:37.

I am fully aware that words such as "delete" are not tolerated here so I will refrain from using them, but the time has come and I will seriously need to potentially reallocate space, and shift things around to accommodate others. I have a bunch of external drives, full of TV Shows, and I need a reliable up-to-date, website/source to know if television shows are current or cancelled.

Any suggestions would be very thankful.

The original post: /r/datahoarder by /u/Damix77 on 2024-08-23 04:01:50.

Title says it all. Currently using a 20tb WD external hdd. Looking to move to an internal drive but never had one that big. Any help is appreciated. Thanks

The original post: /r/datahoarder by /u/_NessJL on 2024-08-22 21:43:56.

Hello Reddit! I'm currently in the process of moving my data from Google Drive and computers to another backup location. I'm currently looking for 500GB-1TB storage solutions which I may access up to everyday or as low as every week for 8-10 years consistently (of which then I will upgrade). These drives need to be semi fast but more importantly, reliable and keep data for years on end.

I have some questions that will allow me to continue. My budget is $50-$100 (I do not require a massive solution right now as I only have little files. By the time my solution fills up, I will purchase a NAS but I can't right now).

1. Would an SSD or HHD be better for me? My father has used a Samsung T3 SSD since 2017 and left it unpowered all the way until 2024, and all of his files were accessible. He also used a Toshiba HHD from 2010 (1TB) and left it unplugged for 11 years, and some of his files ended up corrupting (less than 5% maybe). However, I've seen on this subreddit about the risks of leaving my data unplugged for long term with an SSD. I would however, be accessing the data between everyday to every week/biweekly and would prefer a faster experience with that.
2. Should I go with a pre built external drive? If so, what should I go with? I've heard about Seagates unreliability but also WD/Toshibas direct plugin that can make it dangerous and expensive to repair if needed. Alternatively, should I just get an NVME/SATA/whatever drive and get an adapter and case to convert it to external? How difficult would that be, and would there be obvious benefits? It seems like that option is cheaper per GB.
3. What are the ideal conditions to store my drive in? Would leaving it on my desk connected ready for usage be ideal? (Security issues there). Or should I leave it in a closet until I need it?

Thank you!