The original post: /r/datahoarder by /u/deleted-shaow on 2024-09-30 06:36:34.

The original post: /r/datahoarder by /u/WhenYoung333 on 2024-09-30 06:06:45.

If you ask me , yeah it's for porn.

The original post: /r/datahoarder by /u/BUMRONK on 2024-09-30 02:41:22.

Buffer for DAS storage with primocache

I currently have a couple of 8 bay DAS's attached to a refurbished optiplex. I have spinning drives in the DAS's all setup in a Microsoft storage space. I also have a 8tb drive that I torrent to, as well as seed from to avoid hitting the nice spinning drives on the das, but I am having issues with when sonarr transfers files to the DAS it really slows down the read rate. Causing buffering. I have now added a 240 GB SSD as a cache using primo cache in a attempt to buffer and slow done the transfer rate to avoid hitting the drives at 100 percent. It hasn't seemed to work. Does anyone know how I am supposed to set up primo cache or a better method?

The original post: /r/datahoarder by /u/Mishqueen1 on 2024-09-30 01:02:45.

Yes, this is about an aging parent. An aging autistic parent with OCD. Whom I love. Please bear with me and read carefully. I did a search in the group for this data management solution but didn't see anything that comprehensively amarres my questions. Or, I don't understand how to use Search more effectively (I'm new to making posts).

My dad used to work in a field with high confidentially and security requirements for their customer records. There are also requirements for him to keep customer files available to them if they ask for them, for a certain number of years after their services rendered. We are way past those numbers of years, but he wants them to be available until his death. He has kept every single hard drive he has ever used, and the customer files are co-mingled with his personal files in each computer or laptop.

He still consults in the field on occasion, and that's where this problem derails into a train wreck. He takes Every. Single. Hard drive. With him. While he drives all over the western US to these consultations. He used to take the COMPUTERS themselves, stacked up in his back seat! He is old and drives dangerously but cannot fly because he has 42+ flipping hard drives that he insists must come with him because he wants to be able to give the files to any customer who might call and ask for them. No one ever has, in the history of his business. This is not about the requirements, it is about OCD. His life (and the life of others on the road) is in danger every time he travels, and that is what we are trying to rectify.

I live 14 hours away from him but am going in for a one week visit. He has given me rare permission to take care of this problem for him, so he can carry all these files with him on an airplane without needing a shopping cart.

I have 6 hours per day, times only 6 days, to consolidate and reduce every single one of these drives. I need the easiest, fastest, and if at all possible, cheapest method to get this done.

I numbered these questions so you can skip straight to the answer you know in your response, without having to explain which one you're talking about.

The rundown:

1. Is it faster to move them all onto the same location first, then eliminate duplicates? Or is it faster to eliminate duplicates over and over, separately on each drive, then combine them all last?

2. He thinks SD cards are good enough for this project and likes the idea of carrying a single SD card wallet with him. I think every file will take a million years to move, !each!, so he should shell out for an ultra fast SSD drive. Is he right? Am I right? What's the cheapest way to do this? He honestly has nearly no money.

3. Will a deduplication software be able to identify deletable files without having to open them? He will never let me open them for security reasons, even for a cursory glance to double check for duplicates.

4. Is there a dedupe software that will let me enter parameters for what to delete and what to keep, rather than deciding manually for every batch of dupes? For example, "keep the newest version of every identical file".

5. Is there a dedupe software that recognizes altered versions of the same file? For example, "keep the largest and newest version of every file with the same name" (or even better, if x% of the contents match).

6. Do I need to have operating system versions to match compatibilities to the file? For example, do I need to set up dual boots or even more, to identify files from the 90s?

HALP! If you've never helped a desperate stranger on reddit before, please let this be the exception. Please don't rant about his autism or OCD; he is getting treated for both but I cannot fix either with internet advice. I CAN however fix the hard drive problem with internet advice. Please, and thank you in advance. 🙏🏻

The original post: /r/datahoarder by /u/ntropia64 on 2024-09-30 00:36:44.

I hope this is an appropriate question for this sub.

I manage all the data (photos and videos of the kids, mostly) that my family generates so I try to be careful about data safety and maintenance. The goal is to have a few tens of terabytes always online (plus backups, but that's another story).

I am coming from some bad experiences with ZFS running on an external enclosure (this one, for those that are interested). The enclosure was connected to a dedicated machine (AMD Ryzen 9 with 32 GB of ram) but I was getting a ton of checksum errors, which I could clean and fix but it was just a matter of time before they showed up again. I changed cables and disks, and run all kinds of tests, but at some point I realized it was time to move on.

Since this limited my setup to 4 disks, and I wanted to avoid external enclosures and USB connections, I decided to reuse an old full-size desktop I had lying around, a Dell T3600 with a Xeon processor with 8 cores, 32 GB RAM. On the motherboard alone ther eare 6 SATA ports, which might be a good start, but I was planning to buy a PCIe SATA expansion card. The other good thing about using this machine is that I have also to a lot of spare parts coming from other dismissed machines.

The problem comes when looking at how to power the drives. The power supply has only 3 connectors, which come out of the card to which the PSU is plugged. That's a Dell thing, I believe, which has all power connectors (motherboard, GPU, etc.) coming out from the same power distribution card.

As far as I can tell, there are no SATA exansion cards that would take the power directly from the power supply and redistribute it, but they all seem to assume disks get power elsewhere.

Since other than that, this machine seems to be well-equipped to handle my application, is there any way to extend its capabilities to support the theoretical 6 SATA drives I can attach to it, and possibly more when I get the PCEe extension?

Is there any hope to use this, or I should better be looking at assembling my own machine? I would strongly prefer to avoid this solution as much as possible because of lack of time on my end, and the extra complexity that the process adds.

Thanks to anyone that would have any helping advice.

The original post: /r/datahoarder by /u/aeylores on 2024-09-30 00:34:59.

I'm planning to buy an SSD or HDD but cannot decide which!! People have mixed opinions about this matter, many days that to get SSD but some HDD.

Usage

My main reason of getting a disk is photo and video storage, I mainly want to store those things from my iPhone, iPad and MacBook. Well, the reason for that is so in case I lose my phone or it gets stolen, all my memories, photos and everything won't be erased. (Really important for me). I'd also been thinking about using it for games for my PS5 (but it's not really needed and I just brought an extra idea of using it)

So that's basically it. Keep in mind that I'll be maybe once a month or later, be adding more photos that I take from my phone and possibly putting in into the drive.

I think I'll go with HDD

• I don't really need the extra speed. As I'll use it occasionally, it really doesn't matter if it goes 15 min faster.
• I'm sad that it's very easy to damage it, some drops and the memory can really be gone. (However, I don't see a problem because I'll just put it into the cabinet)
• I heard that HDD have more lifetime than SSDs.
  • Don't also SSDs have something that if you don't power it up on time to time, the cells will be dead and the data will corrupt?

And second thing, don't know the storage that I should get. I'm planning to get 2TB but I think 1tb will be good? Photos on my iphone - 58,39 GB (probably 15 are trash photos that will be deleted) Photos on my ipad - 34,13 GB Things from my MacBook - Less than 180 GB

Note: I live in Iceland where everything is hardly accessible and very expensive!

So , what do you think? What's the best disk for me in this scenario? What brand should I get, and possibly link it for me? Any help would be gratefully appreciated as I've been researching over 2 days on this matter and I can't have a decision!

The original post: /r/datahoarder by /u/CantStopPoppin on 2024-09-29 23:53:48.

The original post: /r/datahoarder by /u/Biologisten on 2024-09-29 23:18:56.

When checking disk activity on my 2x3TB array I get constant 100% utilization and >2 seconds of average queue time. The HDDs are WD RED 5400rpm 64MB cache. I am using this array to seed so it is almost only reading, I can never fully utilize my upload bandwidth and I have made sure the HDD is the bottleneck rather than connectivity. How much would new HDDs with more cache and 7200rpm help? Would it be better to use some SSDs for the most active torrents instead. Would love to use the cheap high capacity HDDs but i wonder if the problem lies with high seektimes and many small reads in which case SSDs are much greater.

The original post: /r/datahoarder by /u/Unusual-Doubt on 2024-09-29 22:51:22.

The original post: /r/datahoarder by /u/goliv04053 on 2024-09-29 22:40:57.

The original post: /r/datahoarder by /u/radraze2kx on 2024-09-29 22:29:53.

Hello Data Hoarders. I recently picked up around 180TB of fairly new storage through FB marketplace (8 x WD HC550 HDDs + 2 x Seagate x18 Exos HDDs, all 3.5"). I plan on using the 2 Exos drives for parity and the 8 WDs for data storage. I currently have a Phanteks Enthoo Pro case housing an ASUS Z10PE-D16 WS with two Intel Xeon E5-2640 v4s.

I can make the space in the existing case to house all 10 drives, but I'd like to be able to have something more easily accessible for hotswap purposes in case a drive goes down.

I'm not familiar with the solutions for this situation. EMC cases seem to fit the bill, but I can't find information on whether licensing is needed for them, or how loud they are. The data storage will be inside my home office next to the existing server, and these particular drives will only be housing data for backup purposes.

I've also considered getting two of the Syba 8-Bay Enclosures and swapping the fans with Noctua fans but was concerned about USB 3.0 bottlenecking the read/write to the drives in the event a drive rebuild is needed. I'd happily consider a rackmount solution as well, as I plan on eventually putting a floor rack into that office to house some of the networking equipment and making it a more formal setup.

Can someone provide some guidance as to what options I should be looking at? Thanks in advance!

The original post: /r/datahoarder by /u/Qusai1 on 2024-09-29 22:29:28.

i am trying to download the text contents Fandom Wiki so far I got the xml file from Stastics page, I just want a way to only get the text from it with out the whole weird formatting tags

Any help would be appreciated!

The original post: /r/datahoarder by /u/Onigumo-Shishio on 2024-09-29 22:21:56.

I am attempting to save and recover the files on an old MAC HDD to my windows system (I no longer have any mac computers btw, just the drive itself)

Its an old MAXTOR 80GB Drive originally made around 2004 and last used properly around 2014 (that date is being generous)

DiamondMax Plus 9

80GB SATA/150 HDD

Im using a Sabrent Hard drive/SSD to usb cord and currently have the free trial of MacDrive, as well as the Hfexplorer program.

The issue im running into here is that its not detecting or running the drive itself and i cant figure out why. When i open MacDrive, it doesnt detect it, nor in Hfex.

The cable itself is fine and lit up, but the drive doesnt seem to show up anywhere i look.

I could really use some assistance as to what i should do, short of finding someone with a MAC computer, as there are a lot of old memories (especially of my dad) on this drive that i dont think were backed up prior and i want to save as much as i can from it.

Let me know if anyone needs anymore info.

The original post: /r/datahoarder by /u/Life_Bridge_9960 on 2024-09-29 21:59:52.

Between family, friends, and clients, suddenly everyone demonstrates a need for a NAS that they can access via Wifi for their smart devices (phone and tablet) and computers.

What would be a good setup and budget setup? Would Raid 1 do? For people who have no idea what a NAS is, $1000+ is a heap price tag.

And most importantly, I need to be able to remote manage it. There is no way in hell I am driving 1 hour to a person's home because he/she thinks the NAS "is not working".

The original post: /r/datahoarder by /u/MusikFurJungeLeute on 2024-09-29 21:50:31.

Are these Exos drives?

this one for example (this is not a referral link) https://www.ebay.com/itm/326271997256

or you can just search "OS OEM". Different sellers have these. Serverpartdeals has one and they say it's an Exos.

The original post: /r/datahoarder by /u/valkyrie_rda on 2024-09-29 21:46:50.

I've been having trouble with my DIY NAS, and I’m hoping someone might have some insight. The system has been running fine since 2018, but recently, drives have started disconnecting randomly. Here's what I’ve done so far:

• Changed the PSU, swapped cables, and moved drives to different hotswap bays + outside of hotswap bays.
• I didn't see this myself, but I saw an error that indicated there could have been issues with a drive connected to the motherboard sata connector not using one of the HBA cards.
• I have two PCIe HBA cards (using an LSI Adapter, SAS2 2008 Falcon).
• I've noticed that the NAS occasionally hangs or times out when I try to RDP into it, which might be related, but I am unsure what is causing this.

Recently, I noticed that plugging in a helium drive into the HBA seemed to cause several other drives to disconnect simultaneously. This makes me think it might be a power draw issue, HBA problem, or maybe even a firmware conflict. This issue seems to happen with both HBA cards. I've been working on this for the past 4 months or so and am out of ideas aside from buying a new HBA card, but I'd like to try a few other things first if possible rather than spending more money on this pc in case I need to replace it.

I'm running Windows 10 and am using StableBit Drivepool and StableBit Scanner. I have roughly 12 hard drives right now in the array.

The driver detected a controller error on \Device\RaidPort0.

The driver detected a controller error on \Device\RaidPort1.

The device, \Device\Harddisk7\DR9, is not ready for access yet.

The device, \Device\Harddisk0\DR0, is not ready for access yet.

Reset to device, \Device\RaidPort1, was issued.

Has anyone run into similar issues? Any ideas on what I should try next?

The original post: /r/datahoarder by /u/Shaihuby on 2024-09-29 19:38:15.

Hi! I am a data hoarder (just like you!) and recently I have been trying to reorganize this famous folder called "Resources" (thunder sound).

It's awful, I have so many files, from video, image, sound, code, 3d models...

They range from stock footage, musics, sound effects, voices, plugins, presets for adobe suite, 3d models, unreal assets, textures, images, icons, GUI.....

Got a lot of them from Adobe Stock, Envato Elements, Humble bundles (a lot of packs), and else.. (4To)

The issue is that it's a pain to store them because they often belong to multiple categories at the same time.

Where am I storing item icons in Game Assets/GUI/Icons? in Images/Icons?

This is why I was wondering if there was a software that could scan this big folder, analyse its content, tag all the files and then sort everything in an effective way.

I would love to explore my assets the same way I explore a huge Notion database, with tags search, content search etc.

Right now I rely too much on Everything to do that but it's not convenient.

Thanks!

EDIT : Also do you know if it can sort the files within explorer? Because I don't know how to organize them in my drive as well.

The original post: /r/datahoarder by /u/PsychologicalSane_i on 2024-09-29 18:52:02.

I have been searching for this for a long time. This is a game I have tried to get it but I just can't so I'm asking if anyone has this file laying around or has a way of getting it to work of the internet archive I would be realy happy

The original post: /r/datahoarder by /u/OnenonlyAl on 2024-09-29 18:46:46.

Hello thanks for any insight. I'm trying to backup my Ubuntu server mainly a Plex server. Going to send the filesystem to a truenas as a backup. Then if needed in the future transfer the filesystem to a new server running Ubuntu with a larger zpool and different raid array. My plan is to do the following with a snapshot of the entire filesystem.

zfs send -R mnt@now | ssh root@192.168.1.195 zfs recv -Fuv /mnt/backup

Then send it to the third server when I want to upgrade or the initial server fails. Any problems with that plan?

The original post: /r/datahoarder by /u/rohithkumarsp on 2024-09-29 18:26:35.

The original post: /r/datahoarder by /u/budbud70 on 2024-09-29 18:10:31.

The original post: /r/datahoarder by /u/Ohno230 on 2024-09-29 16:24:46.

Recently i was thinking i should need an USB with a BIG storage, now..

What i came upon was this:

• https://tvojpc.sk/produkt/adata-sc610-1tb-sc610-1000g-cbk-rd/

It is cheap but seems too good to be true.. does this worth it?

I would keep Games, or an OS, Roms, and more on one of these.

Some help would be needed to decide, my budget isn't large so.. around 60€, 70€ by looking at the range i mentioned, am i reaching too far?

It's just i don't want to keep these files on my PC mainly, plus i want to have it as portable as it can.

Any help is appreciated ^^"

The original post: /r/datahoarder by /u/areyouaoneorazero- on 2024-09-29 15:58:54.

https://preview.redd.it/44gksid2trrd1.png?width=2193&format=png&auto=webp&s=32088c8ded710d3aeb2e2f5a1da39cffc651b0c3

https://preview.redd.it/yvulpmd2trrd1.png?width=669&format=png&auto=webp&s=53e00fb3898dd2f9c9898c1ca0d7108297f2613b

Drive shows up in bios and device manager but i cannot initialize the drive (WD Ultrastar DC HC530 14TB - WUH721414ALE604) it's a refurb from amazon. tried initializing through diskpart and getting the same CRC error. Tried molex to sata aswell, don't know what else to try. replacement is on the way

The original post: /r/datahoarder by /u/SufferingScreamo on 2024-09-29 15:42:47.

I have a boatload of pictures, some even from pre-1900s. However the ones that my scanner seems the struggle with the most are the ones from the 1910s or around there that have a reflective coating to them that you can also see in person when viewing the image. This makes it really hard to properly scan these images even though they are very high quality due to being film and I want to create copies since they are my ancestors. My scanner is the Epson Perfection V19 II and I have played around with a lot of the picture settings but have not found solutions. Some of the pictures come out better than others with reflections only being around the corners but others are completely unusable making it impossible for me to scan the pictures at all. Are there any other strategies I can try for these types of photos to capture them the best digitally?

The original post: /r/datahoarder by /u/DisciplineJaded on 2024-09-29 15:38:44.

I have about 250 GB of family photos and videos on a couple SSD's (Crucial BX500) and want to put them on HDD and maybe a disc format as the actual backups to end up with:

Master backup: Disc / HDD

Cloud: tbd

Master: HDD

Master Copy 1, 2 and 3: HDD

Transfer Drive: ssd

Not sure if an HDD is good enough as a long term storage master backup. HDD for the master drive for sure, and I just need an external HDD drive for my parents and myself.

Open to suggestions on the HDD brand / types and maybe a disc format I can store these on. I plan on sending one hdd via mail and the other hdd to deliver via airplane carryon since some family lives out of the country.