It's A Digital Disease!

The original post: /r/datahoarder by /u/Deep-Egg-6167 on 2024-06-17 07:44:13.

Hello,

I'm about to build another system for my movie collection. I currently have an adaptec 3514-16 with 16x12TB drives in RAID 5. I'm debating about the size of the drives to get next but I'm guessing I'll get 16x16TB drives in a RAID 5.1 config but I'm not 100% sure My collection hasn't grown that much in the last 4 years so 50TB will go a long way.

I've read many debates saying just get an HBA card instead of a RAID card but I've never actually seen any performance (real world statistics) comparing the two. I'm still open to considering either one but would appreciate anyone who can point me to some real statistics vs opinion or based on what they've heard. Your opinion may be 100% correct but I'd love some posted benchmarks.

The original post: /r/datahoarder by /u/Deep-Egg-6167 on 2024-06-17 07:36:44.

Hello,

I like to check when a raid is building (takes a couple of days) what percent it is at. It logs out every 15 minutes or so - any guess how to leave it logged in?

The original post: /r/datahoarder by /u/clickyk2019 on 2024-06-17 06:23:30.

I've redownloaded some videos from youtube with yt-dlp (same videos, same yt-dlp options) however when comparing (diff) the files downloaded 6 months ago with the current ones some, but not all, are different. In some cases the new size is almost half of the previous one.

Does anyone knows if youtube re-encode or modify videos periodically?

The original post: /r/datahoarder by /u/Old-Cheesecake8818 on 2024-06-17 05:21:08.

The original post: /r/datahoarder by /u/Best-Lettuce3074 on 2024-06-17 04:48:50.

Does anyone know?

The original post: /r/datahoarder by /u/Point-Frosty on 2024-06-17 02:04:06.

Hey yall! Looking for recommendations on a box that will convert composite coming from my vcr to hdmi. I would like to upscale to 1080.

I am dealing with old vhs tapes that get snowy at times. I did purchase a Kanex Pro $80 unit and it does pretty good upscaling and interlacing. Unfortunately with my snowy tapes, the unit flashes a big source menu on the screen when snow happens.

Does anyone know of a 1080 upscaller that won’t flash menu’s on the screen during my capture to OBS? Thanks so much for the advice!

The original post: /r/datahoarder by /u/CartoonistNo6669 on 2024-06-17 00:34:20.

I've not gotten either yet, but I'm struggling to figure out of this is compatible.

I'm planning on getting a TS-435XeU (https://www.qnap.com/en-us/product/ts-435xeu#)

And filling it with 4x 10TB renewed Ultrastar He10 HDD (https://a.co/d/8EcBiGu) in RAID5.

I see that these hard drives have Power Disable, and I can't find a concrete indication on QNAP's website if the NAS supports those.

Any advice here?

The original post: /r/datahoarder by /u/gulisav on 2024-06-17 00:09:01.

I'm not extremely tech savy, so I have some possibly silly questions.

Two days ago it's been announced that Great Russian Encyclopedia has been given no funding this year at all and the encyclopedia will be discontinued. (The encyclopedia is a heir to the Great Soviet Encyclopedia, and is fairly decent as far as general encyclopedias go.) Apparently Russia has bigger priorities than funding an encyclopedia... So, I think I might try my hand at saving the encyclopedia's online edition, before it 404s. Now, there are two domains, bigenc and old.bigenc (both .ru domains), and I'll focus on the latter. It seems fairly simple to rip, because each encyclopedic article has a corresponding PDF file, with the URLs only changing their final number (with 6 or 7 digits). I could produce a list of all the possible URLs in Excel. However, if I were to feed that list to a download manager, I'm wondering if that would cause any serious issues on the part of the server. There's probably close to a hundred thousand articles available on the site, and the downloader would also have to check possibly millions of URLs that contain no PDFs. Would this be like a sort of borderline DDOS attack? Could my requests be blocked?

Furthermore, even if I rip all that stuff, it would result in thousands of files with nothing in particular to identify them, as the filenames are just numbers. Is there a way to derive the article titles from the text within the PDFs (which ofc include the title of the article) and rename the files accordingly?

(The PDFs themselves are small in size, so I'm not worrying about space constraints.)

The original post: /r/datahoarder by /u/WriteCodeBroh on 2024-06-16 23:30:14.

Let’s say a friend of mine was thinking about, hypothetically of course, buying a used workstation off of Facebook marketplace. And a lot of those modern used workstations don’t have a whole lot of space for hard drives.

What if this friend drilled a hole in the side of the case, ran the required power and data cables (SATA probably) out to a custom built case with a backplane and a whole bunch of hard drives?

I assume there are EMI and short related risks but frankly I’ve seen people run whole computers on open wooden racks with fans blowing on the components, function just fine for years, also don’t plan to touch/move things much and they’ll be off the floor and out of the way.

So anyway, all that being said, how stupid of an idea is this?

The original post: /r/datahoarder by /u/ryfromoz on 2024-06-16 22:01:57.

I'm curious if there's a list or something out there of media that is difficult if not impossible to find/acquire? Talking tv shows mostly but also movies etc. I have a personal list of shows i'm still chasing myself but would be nice to see if there's anything I have that would need sharing beyond my own 3-2-1 methods of backup.

The original post: /r/datahoarder by /u/MatooMan on 2024-06-16 21:59:26.

Looking to download local copies to my PC from the following publications, anyone able to help me find an automated way to do this? An add on or program ideally.

Thanks

https://archives.thepipingcentre.co.uk/publications

The original post: /r/datahoarder by /u/smartyee on 2024-06-16 21:43:35.

The original post: /r/datahoarder by /u/mdwkelly on 2024-06-16 21:09:58.

Good day all.

Well I have joined the club and am now the proud owner of a Supermicro 45 Bay JBOD Expansion Server Shelf 847E16-RJBOD1 with ~30 drives and ~460TB. Currently have it hooked up via 2 SFF-8088 to SFF-8088 cables to a LSI 9201-16e 6Gbps 16-lane external SAS HBA installed in my "server".

This is replacing my previous setup with the same "server", 2 x LSI 9201-16e 6Gbps 16-lane external SAS HBA cards with 8 x SFF-8088 to 4 SATA cables running to 8 x RSV-SATA-Cage-34 that are/were on a couple of shelves.

Been up and running for about a week and thoughts so far are:

• It looks cool in the 4-post 42U rack
• It is loud! (I knew it was loud but that holy s#$% moment when you first power it up)
• snapraid backup/scrub is only happening at about 2/3 the speed of before (sort of knew this as well)
• that was a lot of screws to remove the drives from the RSV caddies and screw them into the JBOD caddies.
• It looks cool!

As mentioned, I have it hooked up via 2 SFF-8088 to SFF-8088 cables, one for each backplane, and am wondering if I can hook up the other 2 SFF-8088 ports on the JBOD with two more cables to get some additional speed. I did read the manual it it discusses the other two ports are used for daisy-chaining but you never know.

Not being one to let well enough alone, I am now on the journey to repackage my two "servers", one from above and the other used for acquiring linux ISO's, into a couple of 2U cases so I can get them nicely into the rack.

For the latter, am thinking about a RackChoice MicroATX/Mini-ITX 2U Rackmount Server Chassis as I am running a mitx MB and a couple of 3.5 drives and a couple of SSD's with no add-on cards so should fit just nice.

For the former, the "server" hooked to the JBOD, I am looking at this RackChoice 2U Rackmount Server Chassis as it allows full height cards to be used via PCI riser so I can keep using the HBA card I already have. The other option I am looking at is picking up a LSI SAS 9300-8e 12Gb/s SATA/SAS and a couple SFF-8644 to Mini SAS SFF-8088 cables and a 2nd RackChoice MicroATX/Mini-ITX 2U Rackmount Server Chassis but I am not sure if the SAS3 HBA is backwards compatible with SAS2 backplanes.

Anyway, the adventure continues ....

Thanks

The original post: /r/datahoarder by /u/Wibble_Webble on 2024-06-16 21:07:50.

Hi, i want to start a project but i have no idea where to start. I have a barbie movie collection that has dubs in my native language. I found that someone has remastered these movies in HD and i have already downloaded them. The movies are however in English. I want to rip the audio track from the dvd's but just of the main movie and replace the original audio track from the remastered movies. I've already tried to rip the movie with handbreak but the mp4 file came out choppy in image and in audio. I also don't know how to replace the original audio track once i have successfully ripped the audio from the dvd as well as sync it. I've read about using ffmpeg but i have no experience with it except for yt-dlp. If anyone can provide an incredibly dumbed down explanation, i would really appreciate it.

The original post: /r/datahoarder by /u/fourDnet on 2024-06-16 17:53:45.

Found this nifty tool recently:

RSAF - An Android Storage Access Framework document provider for rclone

Based on rclone 1.67 (latest version). First app that I've seen for android that supports mounting arbitrary remote drives (google drive, WebDAV, SFTP) and supports streaming.

Had to manually add it to the battery optimization exclusion list on a OnePlus device (like in 3 different places, for background running, Optimize Battery Use etc.), or it would lose connection.

But after adding it to the battery exclusion list, I could reach over 280 megabits/s streaming 4K HDR video from a local linux machine!

Basically added a config for WebDAV (or SFTP), added an alias to go to the specific folder, and opened that folder within the app. Was able to stream using VLC 4K HDR with very rare stutters via the local wifi.

The original post: /r/datahoarder by /u/Gwyn777 on 2024-06-16 20:13:19.

Hello!

I recently bought Cruelty Squad from steam. It is DRM free from the get go.

What files do I need to save to archive the game?

Something where I could theoretically uninstall steam, download it from my storage, then play without steam.

Thank you for any help!

The original post: /r/datahoarder by /u/EfficiencyFine3560 on 2024-06-16 19:53:35.

Do you just run yt-dlp on a channel and put each channel in its own folder? Do you have a more elaborate directory strcuture? Do you use archive scripts to save stuff like comments and description? Please let me know your system!

The original post: /r/datahoarder by /u/Djinnimania on 2024-06-16 19:45:59.

For context, I dropped the ball recently by forgetting both Mother’s Day and Father’s Day until the day of. They don’t seem upset, but I want to make it up to them by converting their wedding videos from VHS to either digital, DVD, or Blu-Ray. What would be the best way to do so?

The original post: /r/datahoarder by /u/Creator13 on 2024-06-16 18:51:55.

After using a laptop for the past six years and carrying it everywhere, I recently got a good desktop PC again. I've always played it super risky because all my data has never been properly backed up or duplicated. Now I want my files to be available between different (windows) computers. Ideally, every change would automatically get synced between both computers, through a cloud storage provider (that also stores the files for access from outside), as long as either computer is connected to the internet.

Now, plenty of services offer this, in its most basic form. I get 1TB OneDrive though my parents' family plan and OneDrive is pretty nice. It integrates well enough into Windows. But there is one major limitation that makes it pretty much unsuitable for me: I don't want all my syncable data to be in one single folder. I want it spread out over different folders and even drives, because I run quite a few different drives with different purposes.

Is there a service that basically offers a way to set custom endpoints for syncable folders? Say I have a cloud folder /Files, then I want a client that runs on any connected computer where I can set /Files to be synced to G:\Files, or to C:\Users\some_user\Documents\CloudFiles on another computer?

Ideally also affordable and reputable/secure of course, and for single individual users?

The original post: /r/datahoarder by /u/sigh_zip on 2024-06-16 18:22:36.

Looking to dl a bunch of facebook videos. What’s the best tool to use to do it? Jdownloader2?

The original post: /r/datahoarder by /u/Maxxxel on 2024-06-16 17:36:36.

So I have around 4-5 TB of data (thousands of files 100-500 MB) and look for a new way to store them and share them with a link. I would also prefer if those links are generated individually all the time so no one can share the link to get the file multiple times.

Right now I'm paying like 150€/month and that's too much for a hobby.

Any advices?

Shouldn't be a cloud provider who can take down my server, I want a dedicated solution again.

The original post: /r/datahoarder by /u/KhanhEVB on 2024-06-16 16:23:40.

The original post: /r/datahoarder by /u/mudcakes2000 on 2024-06-16 16:21:50.

I've installed aoemi backupper and ive seen there is an option to clone "sector by sector" however I have heard for large drives this can take hundred of hours. Will cloning the standard way work if I have some bad sectors? Or would this be detrimental? Im also not keen on doing it the sector by sector way as im worried my hard drive might fail during the long process. Does anyone have any experience with this ? Thanks

The original post: /r/datahoarder by /u/coffeenerd_ on 2024-06-16 16:12:08.

Knowing that they've completed pilot tests a long time ago, are being deployed commercially, and getting mass produced...

Wondering when would these 30TB Seagate drives become broadly available for us folks?

Any have any real information or seeing any listings across any retailers / wholesalers?

The original post: /r/datahoarder by /u/YesThisIsi on 2024-06-16 15:51:52.

So i have been using on my server Backblaze personal (im not telling on my self how i did, but i have managed to backup my drives). There are tens of terabytes in there.

Because it is pain in the ass to do (And not 100% reliable), im looking into alternatives. Not to replace backblaze but to add some variety. What i managed to find was crashplan.

However, it seems that the upload speeds are SUPER slow (not really an issue because i have my server on 247). But few users also had problems with recovery.

iDrive seems also an option, but to me its seems sketchy unfortunately.

Any more alternatives? I know the proper way to do it would be hetzner or Backblaze B2 or similar. But these really aren't "that" cheap. Cheaper option would be to buy 10tb drive, encrypt it and give it to my friend etc to hold on to.