It's A Digital Disease!

The original post: /r/datahoarder by /u/maguillo on 2024-06-09 18:16:12.

Hello , I am about to buy the APC BX1200MI-MS with 1200VA and 650W (for the price) to back my nas , but the thing is it does not have fans to cool the device like other models , so I dont know if is or not necessary as I dont want the place smell burnt plastic , or how it disipates the heat? Thanks

https://preview.redd.it/xbq80a528l5d1.png?width=306&format=png&auto=webp&s=234677ad79548b0605bc816738f308782835d0f1

https://preview.redd.it/s5alvwq38l5d1.png?width=536&format=png&auto=webp&s=fde26be32e8079eaf9ea384bcd0e89776a763760

The original post: /r/datahoarder by /u/Sasutaschi on 2024-06-09 17:03:28.

So far I've mostly stored Data on the aforementioned methods, but browsing this Sub, it seems like a SSD + Enclosure would be the best way to go.

This Enclosure was recommended.

https://www.amazon.com/ineo-Aluminum-External-Enclosure-C2594-NVME/dp/B07MZQF1H6

For a SSD, I was thinking about the Samsung EVO 980.

Are there better alternatives?

Finally, would it be possible to watch MKV files, if plugged into a TV/PS4 from the enclosure? Will there be a delay?

Thx. for the advice and have a nice day.

The original post: /r/datahoarder by /u/BrinkleyPT on 2024-06-09 17:01:09.

Hi.

I'm building a new PC with 1TB SSD nVME.

What should I get for backup that's reliable?

And if I get something how often should I replace the drive to ensure I don't lose data?

Still trying to figure out what's the best method of image and file backup and what to buy and use, but also replace and when to replace it in order to avoid losing data.

Thanks 👍

The original post: /r/datahoarder by /u/AshleyUncia on 2024-06-09 16:04:28.

So here's the situation; I currently live with my spouse in a one bedroom apartment built in 1922. For this reason there are some real issues with the loads on the electrical circuits between my network storage, gaming PC, HTPCs and so on. Plus just 'physical space' and noise limitations.

As such, when my 16 drive UnRAID server ran out of drive slots, the only solution was to build a second server which is in the Livingroom, in a 4U Rosewill case, sitting discretely in an Ikea Lack table with caster wheels. The main server has a Ryzen 9 3950X and does all the dockers and stuff. The secondary server has an Intel E5 2697v2 and sits there eating electricity for the sake of letting me run 12 more drives.

But we're moving! Three floors! Gonna run ethernet in all the walls. There will be a finished basement area for 'the gaming goodness' and I can finally set up network and storage in a real rack, on the unfinished side of the basement, with it's own 15amp circuit and where no one will care how much noise anything in there makes. That means I an get disk shelf and make all of this way less stupid!

The main plan is to retire the server inside the 4U rack case, then transplant the main tower server into that 4U rack case and expand it's drive capacity with a disk shelf. So here's where I have questions:

Firstly, things like the NetApp DS4246 and related seem to be what I'm looking at. All my drives are SATA, to these disk shelves support SATA out of the box, is additional hardware required for SATA drives, or do I need to look for something alternate/specific?

Secondly, these shelves offer up to four PSUs for redundancy, but how many are needed at minimum assuming 'up time' is not a major concern? Also what kind of power consumption should I see beyond the drives it's powering? I should def see an advantage over a whole 11 year old Xeon running, right?

Thirdly, for the 'host server' to access this kind of disk shelf, I should only require something like an LSI 9201-16E and a quartet of 8088 to SFF-8088 cables, right? From there on, the host device should just have an LSI controller which see's up to 24 drives on it, and it's all happy and 'just works'?

The original post: /r/datahoarder by /u/peliciego on 2024-06-09 15:47:11.

Hi folks. I wonder if it is worth using the "wayback machine" and "archive.ph" addons for archiving random websites when you are navigating across the internet.

Sometimes I focus on old websites (*index.html or other dork commands). Other times, it is local news in my surroundings. And from time to time, websites in minority languages. I don't save locally in large quantities. Do you think this strategy is worth it?

Sometimes it is like planting a forest. You may never see the results in 100 years.

The original post: /r/datahoarder by /u/emanknugsaeman on 2024-06-09 12:33:00.

Hello

I am in need of a SAS/HBA expander but I have no more empty PCI-E slots

I remember this being a thing a few years ago with power from molex but now I cant find any with SATA power

Do they still exist? what are they called?

I have two 9211-8i HBA cards if it matters for compatibility

thanks

The original post: /r/datahoarder by /u/Revolutionary_Cod672 on 2024-06-09 10:09:20.

Hi all,

I've got a 12TB home server and I'm trying to use Macrium Reflect to run backups. In an effort to cut costs, I'm trying to backup onto smaller external HDs. I've got one media library that's about 6TB that I'm trying to put onto a drive that's got an actual capacity of 4.5TB, I'm trying to rely on compression to make that work.

The issue is that I've tried with both medium and high compression but the backup always fails due to insufficient space. Does the compression happen after the backup takes place? Or am I doing something wrong?

Wasn't sure if I needed to have 6TB of space available initially, then it does some compression afterwards.

Thanks in advance.

The original post: /r/datahoarder by /u/gpspam on 2024-06-09 09:45:13.

Hello everyone, I'm a bit new to true data hoarding and I had made what is probably considered rookie mistakes.

Some backstory: I had an unfortunate ssd failure which cost me about $1000 to recover the files. After some research I've decided to set up a NAS w/ RAID1 (and other back up methods). Now I have some questions to help me transition/transfer/migration from my old external hdd setup to my NAS solution.

My first question mainly revolves around keeping file integrity when transferring files. What programs are best at doing this? I've done some research and I've currently chosen TeraCopy. It looks pretty good; other posts have suggested stuff like Robocopy but I couldn't find/get it to work (maybe it's command line stuff that, though I admittedly didn't look too hard since I don't trust inbuilt windows stuff that much). How good is TeraCopy and its file integrity verification?

My second question is about checking files for corruption, mainly videos. This one is a bit of a shot in the dark, a hail mary hope of mine that I can fix this headache inducing rookie mistake of mine. Long story short, I had to reinitialize my NAS due to changing its setup. When doing this, I copied data I had on the NAS to a ext HDD (no verification done, I now know it was a stupid rookie mistake) totaling approx 3.5 TB of data, mainly video files (probably around 1k hours). Now I found at least 1 of them has a bit of corruption, where about 20 seconds got messed up. Is there a way or program that can find these kind of problems with files? I'm guessing probably not, but if there are potential solutions I'd love to find them. Otherwise, I guess those errors/problems will just exist and years later I'll find out and lament that if I knew years ago I could have replaced those files but not when I do.

Thanks for your help and I'll reply if I have any follow up questions.

The original post: /r/datahoarder by /u/glowcialist on 2024-06-09 09:15:56.

I tried TubeArchivist, and it worked great for maybe 500 vids, but now seems to be completely blocked, I'm assuming that any script utilizing yt-dlp would face similar issues?

4k tube seemed to work alright for individual playlists at first, but now seems to be consistently throttled to like 50 kb/s.

Any ideas?

Edit: Please forgive the missing apostrophe in the title. I won't do it again.

The original post: /r/datahoarder by /u/HalluxTheGreat on 2024-06-09 06:47:01.

Looking for advice on how to compress some of the gameplay videos I make in some video games. I typically record in 3440 x 1440 30fps with a bitrate of 10000-15000 kbps. And at the end of the day or week I use handbrake to cut the size to about half. A lot of my clips arent for posting to streams but to just compare my early gameplay with myself later on to see how I changed with 0 hours in a game vs 100 or even 1000, or to just capture the moment when playing with friends.

Does anyone have any workflows in capturing their own gameplay and storing it? Naming schemes, settings, scripts, etc...

I've been looking at alternatives such as Shutter encoder as well.

The original post: /r/datahoarder by /u/GuillermoBotonio on 2024-06-09 04:00:21.

Anyone know why I would suddenly not be able to access irc.hackint.org? I was able to go on there for about 3 days then its not loading. The guy I talked to from the page says the server is loading for him. I can get on Hackint.org ok but not the IRC.

The original post: /r/datahoarder by /u/xd-Drewski13 on 2024-06-09 03:18:05.

I'm somewhat of a fan of track and field fan and this was one of my favorite sites to go on back in the day. It seems that the owner is unsure if he can keep it up and is running out of time/energy to maintain it. I was wondering if there would be a simple way to back it up.

It contains thousands of threads about information that would mostly be lost to time if it were to disappear.

I have a fairly large server for movies and shows but don't have to experience scraping and hoarding data like this. Any ideas? I know this site is a certain type of forum template, but I don't know which one it is or the best way to go about this.

The original post: /r/datahoarder by /u/burning_torch on 2024-06-09 02:40:52.

I formatted a drive full of videos by accident on my Ubuntu 22.04 computer. Stupid me. It was a full format, not a quick format, but I stopped it only a second or two after it had started. I ran testdisk to check the damages and try to recover the files; it didn't really work all too well. I tried to run photorec, but the software is unusable - my input was randomized and would constantly change if it even accepted input at all; this wasn't a mapping issue, as the right arrow key would act as arrow up, enter, arrow down, or any other random input at any given time. Either way, I eventually found and ran R-Studio's R-Linux, which seemed to work fine, if a little unintuitive. I ran the software and seemingly recovered a lot of files; among others, I recovered a lot of mp4 files. This was expected, as the drive was filled almost exclusively with videos. However, R-Linux does not have built in capabilities to recover webms or other video file formats like qt, and I know there were a great deal of those files on the drive. Does anyone know of any good ways to recover those files as well?

I know R-Linux has the ability to add custom file types by building an xml file for that type. I wouldn't know where to begin on getting the information for such a file, but does anyone have one that would work for the not included video file types (webm, qt, etc.)? Or does anyone know of a software that has the ability to recover those files?

The original post: /r/datahoarder by /u/DGU_kibb on 2024-06-08 22:16:04.

I'm planning my next NAS. Definitely going for an array of larger capacity drives. I bought new drives for my last build, but im going to have to buy several 12tb drives for my next one.

I know if you have backups then it doesn't really matter (and I do have backups) but I'm curious, i know serverpartdeals is reputable around here, but are people using these in their main nas? Or are you using them purely as backups/cold storage or for unimportant data at the most?

The original post: /r/datahoarder by /u/chuckremes on 2024-06-08 21:53:49.

I will share some information and then ask a question too.

I like this site for tracking hard drive prices. Last September I bought a bunch of 16 TB drives for $10.6 per terabyte and then I saw the price go as low as $9.40. For the 16+ TB sizes it's now been hovering at around $14/TB for months. Very concerning.

https://diskprices.com/?locale=us&condition=new&disk_types=external_hdd,internal_hdd,external_ssd,internal_ssd

So when can we expect to see those 30+ TB drives hit retail? The older articles I read all indicated 2024Q1 but we're about to exit 2024Q2 and I still haven't seen any. What's the latest buzz?

The original post: /r/datahoarder by /u/NotAnADC on 2024-06-08 20:13:09.

Thank you for any help! Been trying to download mega files but hate that I can't save the folder names

The original post: /r/datahoarder by /u/finbarrgalloway on 2024-06-08 19:48:46.

I know for hard disk storage they often tell you to leave 1/3 to 1/4 free to not stress the drive, but does this hold true for a DVD? Or can I fill them up to my hearts content?

The original post: /r/datahoarder by /u/nlj1978 on 2024-06-08 18:56:14.

After the help I got here on ripping my cd collection I'm jumping in the deep end. I'm putting together a media server. Have a HP z1 G5 tower workstation with i5-9500 on the way but still have decisions to make in terms of hardware and software.

I'm finding mixed data on ECC ram support. Apparently the motherboards come in a couple variations. Once I confirm I believe I believe ECC is a better choice for this application. Still need to verify but I believe the board supports either 64 or 128gig. That said how much ram should I use?

Mobo has 2 m2 slots and 4 sata ports. Computer comes with a 256g nvme. I've read a little about using m2 Intel Optane drives for improved server performance. Anyone have any experience or input on this?

Drives I'm still pondering.

On the software side I am leaning towards TrueNas and Jellyfin. Both seem relatively user friendly to someone with limited server knowledge. Thoughts?

The original post: /r/datahoarder by /u/cl326 on 2024-06-08 18:42:10.

I have a Windows 11 system with many folders, sub-folders, and files. I want to keep only one copy of each file based on its MD5 hash, including its filename and extension. In the end I want just one folder with all the unique files. Is there any easy way to do this? If not a specific app, I'm willing to write an app or script in Python, Ruby, or PowerShell. Any thoughts or suggestions?

The original post: /r/datahoarder by /u/Nayko93 on 2024-06-08 18:38:35.

I just found this deal, a 7.68TB NAS SSD for 196€, that's 0.02 cents per GB !

I was thinking it could interest a few people here

https://fr.shopping.rakuten.com/offer/buy/11626286226/disque-dur-interne-7-68to-wd-ultrastar-dc-sn655-2-5-u-3-pcie-4-0-nvme-wus5ea176esp7e3.html

I'm not even sure it's real but it look like it, seller have a good reputation and the website is legit

Maybe it's a price error, I don't know, but I've seen other posts talking about huge deal on those SSD so it seem this kind of deal is not impossible

I tried to place a order to see if they ship outside of France and unfortunately they don't, so you either need to be in France, or use a friend or package forwarding service

I'm almost tempted to buy 2 myself, since I'm looking to make my first home NAS

That's a lot of money but for this much storage it would be dumb to pass it... but I know nothing of those SSD or NAS SSD in general, They need a PCI adapter to plug on a normal MB and I think I've read somewhere they heat up a lot ?

I would be more comfortable dealing with normal sata or m.2 SSD... but such a deal.. I'm really tempted

The original post: /r/datahoarder by /u/makzero on 2024-06-08 17:20:58.

The original post: /r/datahoarder by /u/NighthawkE3 on 2024-06-08 17:05:59.

Okay this is a potentially weird one, I’ll do my best

Very quick summery: I have about 5000 files that must be renamed from:

To Simply

I have about 5000 of these incorrectly named files, and they can't be used in the current format. I have both Windows and Linux operating systems at my disposal, any help would be massively appreciated

The original post: /r/datahoarder by /u/Yukinoooo on 2024-06-08 16:39:54.

My goal is to use my DAS on my PC and my media player (like a kind of Nvidia Shield, not Android or IOS, just the KODI interface under GNU/Linux) safely. I'm wondering if it's a good idea to use the two ports (PC and my media player) of a usb switch + a power supply and one port for my DAS ? If not, which solution should I use ?

The original post: /r/datahoarder by /u/Greenie5FSHGMM on 2024-06-08 16:07:28.

The original post: /r/datahoarder by /u/Cyber_Akuma on 2024-06-08 15:10:00.

I have a LSI 9260-8i, this was actually reflashed from the original IRM ServeRAID M5014 it arrived as. It has since also been upgraded to the latest firmware from LSI/Broadcom, which is 12.15.0-0239 (also the card at boot identifies as BIOS version "3.30.02.2 (Build June 17, 2014)"). I am just simply using it in my Windows 10 system, not as part of a server or NAS.

This card had been disconnected from my system for about 6-12 months, as well as it's drives, I recently reconnected everything in a new system. I have four HDDs in a RAID5, but had recently acquired the license key to enable RAID6 and had installed a 5th HDD in preparation for that. I had a few errors at first, but many things in the system were at first giving me errors so I didn't think much of it as I had performed several upgrades and changes at once.

I eventually got everything booting properly and then opened up the RAID Windows management software (Version 17.05.02.01 at the time) and it seemed to be going ok. It was performing a Patrol Read on all of my drives and was recharging the battery (Though it claimed the battery was bad, but it was new, so I figured it needed to do a recharge cycle and re-learn to see it as good again). It said the Patrol Read was only going to take 10 minutes but I knew it was going to take hours. Halfway in, at about the 3-4 hour mark, the software completely stopped responding. I restarted it, and now the card was showing that absolutely nothing was installed to it.

I performed a reboot and now I kept getting an error message during the card's initialization during post:

LSI MegaRAID SAS-MFI BIOS Version 3.30.02.2 (Build June 17, 2014) Copyright(c) 2014 LSI Corporation Host Adapter Bus 5 Dev 0:

F/W is in Fault State MFI Register State 0xF0010002

Adapter at Baseport is not responding

No MegaRAID Adapter Installed

The card then could be seen as installed, but the drives were not showing up, and the management software could not even tell a card was installed anymore. I tried updating to the latest management software (17.05.06.00) in case it might at least see there is a card installed, with that being it's own can of worms of expecting me to manually install OpenJDK and set the environment paths myself, it also just gets stuck loading the application.

I tried MegaCLI, StorCLI, and MegaSCU (I admit I am not too familiar with managing this card through a CLI) but -v and -AdpAllInfo -aALL but they all returned nothing. I tried disconnecting the drives in case one had somehow become so fault during storage that it was crashing it, and no difference. I tried the only other PCI socket in my motherboard and it would not even boot then, guess that socket isn't even working with everything else installed in my system.

I have no idea what to do now. The card refuses to work, claiming it's suffering some kind of firmware fault on POST, none of the software seems to even detect the presence of the card at all despite it physically showing up in Device Manager (although with an "An I/O adapter hardware error has occurred." error) and HWiNFO, and I am not aware of any way I can attempt a force-reflash of the firmware in case it's a software issue (although I somehow doubt it) or of what else to try.

And yes, I have a backup of my data.