It's A Digital Disease!

The original post: /r/datahoarder by /u/LandRoverMedic on 2024-05-30 06:26:52.

Hi all, trying to build a setup for transfer of home movies etc, anyone having luck with ADVC-55’s? I see a few on ebay at a decent price. I hope to run with FireWire card and win11, not set on capture program yet. Was going to run with an old SHARP VC-684 although doesn’t have s-video so may look for another.

Appreciate any help. 👍🏻

The original post: /r/datahoarder by /u/Open-Entertainer6031 on 2024-05-31 01:02:10.

So I have some questions and I need some advice to increase my storage space. Some background information, I only have 1 TB of storage and I am running a windows 11 computer. I make youtube videos and storage is a big issue for me. So, the questions.

1. What is the difference between an SDD and an HDD?
2. What should I get to store my ungodly amounts of footage?
3. What hard-drive should I get within my 150 dollar budget?

Keep in mind that I need quick access to these files so editing and recording is easier

The original post: /r/datahoarder by /u/NikelKola on 2024-05-31 01:01:01.

Over the course of my life so far I have accumulated quite a bit of digital content that I use for private consumption. I plan on beginning to archive it to dvds/blurays so when worst comes to worst on my media servers or digital textbook libraries etc. I will have original copies on discs to restore from. I am looking for any useful recomendations such as dvd/blu ray types, avoiding disc rot, best setups etc etc (I have seen some posts that indicate it is best to write on the slowest setting to ensure disc longevity). I do not even have a blu ray burner at the moment as I have become so reliant on purely digital content. That is why I am putting a plan in place now so I have a physical archive of my private library.

The original post: /r/datahoarder by /u/the_toad_can_sing on 2024-05-31 01:00:28.

I've just had a Seagate die on me, losing several TB of my movie collection. I'm looking for this to not happen again (third time now, actually). The point of these things is to be backups, but if the backups can die, they're useless. How do I store data and KNOW that it's not going anywhere? Where is a genuinely safe place to hoard my stuff?

EDIT: Thanks everyone. I got a bunch of good advice here to work with. I appreciate the help you offered!

The original post: /r/datahoarder by /u/only_mod_lad55 on 2024-05-31 00:36:24.

The original post: /r/datahoarder by /u/IGPerrish on 2024-05-30 23:05:50.

I'm going away on a trip to the countryside where I won't have access to internet, and I'll need to access a very specific website: all-guitar-chords dot com

I've tried wget, and Httrack seems to work just fine, but it doesn't download the main resource from this site (the live fretboard thing)

Is there any other tool or a simpler way to download it?

The original post: /r/datahoarder by /u/DatasTemporalLobe on 2024-05-30 22:27:01.

Trying to get a WD Passport Ultra to work on a Mac in order to back up an iPhone. I see the Western Digital app has an option to download a driver (Paragon) for NTFS.

Is it better to download the driver and use NTFS or reformat to HFS+? I like that I'd be able to use the hard drive on a pc if I go with NTFS with the Paragon driver but am I losing any functionality on the Mac?

The original post: /r/datahoarder by /u/ThatGuyFilms on 2024-05-30 22:09:34.

I've been scouring the internet to try find a 1u rack that has 2x external 5.25 bays on the front.

The closest I've found it this: https://racknex.com/5-25-inch-half-height-drive-bay-rackmount-kit/ but it's 1.33U not 1U

Any recommendations or anyone done this before?

The original post: /r/datahoarder by /u/CyclicRedundancyMach on 2024-05-30 21:54:24.

All,

I am looking to cold-store about 25tb of video along with the normal user data. We are full-time RVrs and the continuous movement increases the risk of a full crash, risking all of my data. My wife would be less than pleased. In an attempt for a happy marriage, I wanted to purchase a tape drive for simple cold backups. I would do a full backup followed by an incremental every month or so, rotating them. I'd also do a full data backup and mail the tape(s) to a friend for safe keeping.

I am just not sure how to connect an LTO. Suggestions?

• The NAS has USB, gigabit RJ45s (CAT6), and a USB, a PCIE expansion slot.
• All of the drives seem to have SAS connections.

I honestly thought that this would be 15 minute no-brainer. would have thought that this illustrious group of data-centric technocrats would have 15 fully documented methods. Instead, there is nothing at all.

I would appreciate your advice.

The original post: /r/datahoarder by /u/Few_Landscape_573 on 2024-05-30 20:46:20.

What are good brands to get and which ones to avoid?

Seagate Exos?

Iron Wolf/Iron Wolf Pro?

Seagate Barracuda/Barracuda Pro?

Toshiba brand hdd?

The original post: /r/datahoarder by /u/fenderbender8 on 2024-05-30 20:20:50.

I am new to the diy NAS scene, and have decided on creating a N100 mini PC NAS as it meets my needs for low power consumption and enough performance for my use case. However, seeing as the mini PC I have only has 1 NVMe slot, I was wondering if it would be fine to hook up 1x Sata SSD over the LSI card to act as the boot drive and 7x HDDs in Raid for storage? Would this work?

The original post: /r/datahoarder by /u/freedomfriis on 2024-05-30 17:52:37.

I've been using it for quite a while and copying is fine, but there seems to be an issue sometimes when moving files.. it will say the file already exists (it doesn't), so you click overwrite, but then the file is neither on the destination or on the source drive.

This is the second time it's happened to me, so this is just me warning people with lots of data to not use Teracopy. Luckily I had a backup in place, but that's from a few months ago and a lot of the file names need to be renamed again, it's a few hours of work but I'm glad I still have ~95% of what I had before.

The original post: /r/datahoarder by /u/LuckyRide on 2024-05-30 17:13:02.

As always, I don't work for them, but I really like the product.

"Synchronize Files and Folders" => https://freefilesync.org

It's really just a copy program - pretty typical and standard. Except it does SUCH a good job.

You can set up sessions that copies when you run them - so update, mirror, things like that, to arbitrarily complex sets of disks and files. I use it extensively for backups to always know my files are backed up. It needs to be kicked off manually, but it just works so well and I like monitoring the steps.

Most especially, I move files around between diff folders (think picture sorting, etc) and it will figure that out and "move" the files versus "always re-copy". So it really speeds everything up.

So really what I use it for is "make sure every file is backed up properly" - and it does it really well - it "never gives up until success" no matter what happens. You can just re-run and make sure it's "all up to date".

It supports Windows, Mac, and I think linux - so same on all platforms. It's donation-ware - and I think there is some more features if you donate - but I don't remember since I donated since the very beginning.

No other tool really does it as well - no Windows copy or anything like that gives me any confidence like this does.

The original post: /r/datahoarder by /u/Alt230s on 2024-05-30 16:42:25.

Original Title: Linus Media Group is working on digitizing the Reboot master tapes; they already have the DCR-300/DCR-500 VTR machines to play them back, but they need documentation and/or experts to sort out hardware issues

The original post: /r/datahoarder by /u/TheRealXmo on 2024-05-30 15:56:59.

I'd love any guidance on how to [ideally in bulk] download 5-10k videos of various keywords. Storyblocks shut down my account after 1000 manually downloaded videos. Thanks in advance for any help.

The original post: /r/datahoarder by /u/Jack15911 on 2024-05-30 15:13:03.

This is an honest question because most people who are happy with their service don't write about it.

I currently use external drives to swap between the home safe and the safety deposit box, but want to add personal backup data into the cloud so I can cut down on external backup drives (individual drives, not NAS).

Most reviews on the web rank iDrive pretty highly, while mostly I see unhappiness on Reddit. Does iDrive work mostly or does it not?

The original post: /r/datahoarder by /u/pipmike on 2024-05-30 14:48:36.

I could use advise on which syncing software to use for a Mac and two external hard drives.

Scenario:

• I have one external hard drive as my primary "hoard" drive to which I actively add large files (1+ GB), move files to different folders, change file tags, etc.
• I have a second external hard drive that I use as my first-level disaster recovery in case my primary drive fails. The second drive is currently one-way synced to the primary hard drive using a rysnc script i wrote.
• I don't need to store changes or previous file versions. Just want to mirror one drive to another.

While rsync gets the job done, it doesn't handle the above efficiently because any changes are seen as new files, which means it's constantly writing/re-writing large files to the secondary hard drive.

• If I change the name of a directory including 100+ GB of files, rather than just similarly rename the directory of the secondary hard drive, rsync will delete all of the files, create a new directory, and re-sync all of those files.
• If I rename a file, rysnc will delete the file and then rewrite it.
• If I add a MacOS file tag to the file, rysnc will delete the file and then rewrite it.

Thus, if I make any directory changes or tags, rsync can take hours (even days) to re-sync. I can imagine that's not healthy on either drive.

It would be great if MacOS had a native function that said "if I do anything to Drive A, do the same thing to Drive B", but I haven't found it if it exists. Thus, I'm looking at other options (Chronosync, Carbon Copy Cloner, etc.) that might be a better solution for my use case.

Open for all suggestions or feedback.

The original post: /r/datahoarder by /u/Ilegator on 2024-05-30 13:26:39.

The original post: /r/datahoarder by /u/Valuable-Chance5370 on 2024-05-30 13:16:37.

The original post: /r/datahoarder by /u/perecastor on 2024-05-30 12:20:17.

I found a large folder named found.000, I know this is linked to data corruption and bad-sectors but what it means is unclear to me.

Should I change my SSD? Are the bad sectors not used anymore? If I format my SSD would these bad sectors be used again?

If anyone can clarify this, this would be great

The original post: /r/datahoarder by /u/Prestigious_Tax7415 on 2024-05-30 11:10:24.

I got the MacStudioM1 Max 1tb thinking it was would be enough storage. It's not. I read online that I could setup dual external SSD in RAID 0 (honestly idk what it even means but I just know it will be twice the speed as singular storage) on the thunderbolt 4 port which is apparently capped at PCIe gen3 speed. I got two Acasis external SSD enclosures for NVME M.2 SSDs that apparently cap out at 3500MB/s read and 3000MB/s write. What I heard is that because thunderbolt 4 is capped at PCIe gen 3 speeds I should just be looking for PCIe gen 3 SSDs instead of gen 4 but what I realized is that some of the SSDs are roughly the same price. I understand that getting a '3500MB/s read and 3000MB/s write' I most likely won't hit those speeds exactly. My question is if I used a less popular gen 4 SSD like a Crucial T500 would it be better than a more popular branded gen 3 SSD like the Samsung 980 (non pro)?

The original post: /r/datahoarder by /u/RileyKennels on 2024-05-30 10:42:45.

I've been using Snapraid without issue for some time but for the past two weeks regardless of running the default scrub to completion my array is stuck at 40% not scrubbed. I have been using the default Snapraid Scrub command which usually chips away at 8% of it on each run. However for the past two weeks I have been stuck at 40% not scrubbed. I even ran a snapraid -p 5 -o 1 scrub last night and it still stays at the 40% not scrubbed. Any ideas? The graph changes so data does "appear" as if it's being scrubbed. But there is zero reduction in percentage after scrub and scrub completes without any errors and takes it's usual hour or so. Ideas?

The original post: /r/datahoarder by /u/ThatrandomGuyxoxo on 2024-05-30 09:28:41.

So I've been thinking about getting a new USB drive or a new external HDD to store my personal data. I wonder what is better regarding long storage times and why. USB is pretty handy and if I don't drop it I dont see any reason not to use it (speed, size)

The original post: /r/datahoarder by /u/jyssys on 2024-05-30 08:46:03.

Context: I'm going to run Linux file server VMs on VmWare ESXi. Each server will have two virtual disks connected: one for live data, and one for backup (on separate physical hard drives). The plan is to use Rsnapshot to backup the live data onto the backup data disk.

In the past, I've had troubles where files has somehow gotten corrupted, and then the backup of the working files has rolled out of scope in the backup scheme, losing me those files. I'm told that there are file systems that can help me avoid that sort of thing. But which one? For the backups, I'm thinking simply ext4 since it's just rock solid. But for the live data, something like btrfs or zfs sounds good, but I cannot make my mind up about which one, or even if either is what I want. Ideally, I could run some tool once in a while, and if the tool spots corruption, I could just restore the file from backup. Which is best for this out of btrfs or zfs? Or is there a better option?

The original post: /r/datahoarder by /u/Hostile_18 on 2024-05-30 05:21:20.

So I've recently gone from a 25tb ssd NAS to a 120tb HDD one. Now I have the space I've got the dilemma of if the space remuxes take (and serving to clients) is worth the extra sound and video quality.

My main issue being how good an encode in x265 at say one third (or less) the size actually is. I've being testing on my 77inch oled and it's hard for me to get over the line of going for remuxes. At movie would be around 40gb and a single tv episode would be 8-12 gb.

What way did everyone else decide to go? Any regrets/thoughts? Just a reminder this would be using decent encodes only, around 6-7gb per movie and 1.2-4gb per tv episode encoded.

The other question would be for that content where there is no 4k disc available, would you go for a 4k DL or a 1080p remux/encode?