It's A Digital Disease!

The original post: /r/datahoarder by /u/saiyan7701 on 2024-08-30 05:40:48.

I can’t seem to get these drives to read in ubuntu so I can sg format and change sector size for use in unraid. when I use scan inside Ubuntu it just says virtual disk it doesn’t have the actual drives listed. Unraid doesn’t see them, neither does windows. Don’t see them in bios either, kinda lost. Any help would be appreciated.

Card is lsi 9207 -8i Drives are ultra star hgst 12gbs he10

I did try using my windows pc to look at the lsi card and its listed as IT firmware if that means anything

The original post: /r/datahoarder by /u/rojo_salas on 2024-08-30 04:57:00.

No context! Whatever comes to your mind quickly, which one would you choose?

If you have the time to answer; why did you choose it?

View Poll

The original post: /r/datahoarder by /u/PM_EXISTENTIAL_QUs on 2024-08-30 03:05:36.

I understand mac isn't the first choice for this kind of a setup, but I really love the ecosystem, and I want to build my server using a macbook.

My question is this - I will be attaching 2-3 SATA SSDs to this, and I am looking for recommendations on racks that can hold them and connect them using thunderbolt.

Does anyone else use this kind of setup? would love to know tips on best practices to store and catalogue files!

The original post: /r/datahoarder by /u/tenclowns on 2024-08-30 02:44:14.

So I forgot my backup drives (luckily I have all the improtant files on two drives on my computer as well) in a box outside in the rain, maybe half a cm of rain managed to pool at the bottom. I assume I have to dry them, I'm using air now from a a fan, but maybe heat is better?

The original post: /r/datahoarder by /u/oeCake on 2024-08-30 01:46:11.

The original post: /r/datahoarder by /u/HTWingNut on 2024-08-30 00:21:55.

Was looking at these 16TB Toshiba MD08 (MD08ACA16TR) hard drives at Server Part Deals: https://serverpartdeals.com/products/toshiba-md08-md08aca16tr-16tb-7-2k-rpm-sata-6gb-s-512e-desktop-3-5-recertified-hard-drive

I can't find the spec sheet on these drives anywhere though. Does anyone have the spec sheet and/or know the difference between these and MG08 drives?

The original post: /r/datahoarder by /u/Sincere_Friend on 2024-08-29 23:40:06.

Hello, seems like if Plex streaming is the use-case then a mini PC is a must to complement a DS923+. Is there something which gives you the expandability of the DS923+ and the encoding capabilities of the DS423+ all in one?

I will be using 18TB exos drives. I am looking for around 80TB or thereabouts.

Doesn’t have to be Synology. Open to others.

Thank you

The original post: /r/datahoarder by /u/MrPeach4tlanta on 2024-08-29 23:34:05.

The original post: /r/datahoarder by /u/digitalsignalperson on 2024-08-29 23:15:19.

While converting a setup from ZFS to XFS I had an interesting real world test to try. I'm experimenting with keeping my own checksums (combo of reflink snapshots with efficient xxHash scrubbing), so the test is comparing the speed of mass checksumming all files with

find . -type f | parallel -j $(($(nproc)-2)) -X xxhsum -H3 > /tmp/test.xxh3

The set of files I'm testing is from a ZFS dataset with ~130 git repos totaling 730k files. These are mostly small files and with LZ4 compression the reported compressratio by ZFS is 1.54x. The space used by refer is shown as 18GB. On the XFS side du reports it as 29G.

This should provide an interesting test of whether XFS is slower dealing with small files, or if ZFS has an advantage in a case where there is a decent compression ratio. My original thought was that zfs/btrfs may be faster than ext4/xfs because of the faster read speeds with compressed data (per this benchmark)

The setup:

• 2x TEAMGROUP MP34 4TB with DRAM SLC Cache 3D NAND TLC NVMe 1.3 PCIe Gen3x4
• the original ZFS pool is on LUKS in raid 1, including params: compression=lz4, atime=off
• I detached the 2nd drive from the pool and reformatted it for the stack of mdadm -> luks -> XFS
  • mdadm --create /dev/md0 --level=1 --force --raid-devices=1 --size=3709G /dev/nvme0n1p2so that I can add the 2nd drive to RAID1 later
  • cryptsetup on /dev/md0 with same params as original pool
  • mkfs.xfs with 2KB inodes (I'm experimenting with extended attributes)
• copying the dataset over with rsync -a took 5 minutes averaging 93MB/sec
• ZFS is using zfs_arc_max set to 4GB so I'm not bothering clearing l2arc which might be favorable to ZFS
• otherwise doingecho 3 > /proc/sys/vm/drop_caches before runs

Results:

• ZFS three runs: 1m39s, 2m4s, 1m51s; best 1m39s
• XFS three runs: 24.3s, 25.9s, 26.6s; best 24s

XFS was 4x faster.

Think this was a fair test? Possible caveat that the ZFS pool is at 66% capacity and has a bunch of other datasets and snapshots, but I'm not sure if that matters.

The original post: /r/datahoarder by /u/Charrzooka on 2024-08-29 22:57:38.

Hi everyone,

As the title asks. I've just hit my PS5 storage limit and need an external drive.

Are there any decent usb storage? Or do people almost only buy the large external drives?

Thanks

The original post: /r/datahoarder by /u/USMCGRUNT_0341 on 2024-08-29 22:22:27.

Sorry for my lack of knowledge, I searched the sub before posting and I saw a lot of information, but most was above my understanding.

I am looking for a "longer" term storage solution for photos and files. I do not need to edit them or anything like that. I need to transfer them and let them sit for months or years before they will even be opened up again.

From what I read, HDD would be better because it is recoverable in a worst case situation. However, I plan on getting two for redundancy. Once the files/photos are on here, I am deleting them from my phone and other storage. I have older WD's fail with newer version of MacBooks and had to use their plug in to access them.

Can someone recommend an external drive that is portable? I use all Apple products and only need 1TB at most.

Thank you!

The original post: /r/datahoarder by /u/ALT703 on 2024-08-29 22:15:53.

I want to download every single image from a website, specifically "https://laby.net/cloaks"

I only want the cloak images, not other skins or anything from other directories. The download link for a single one seems to be "https://laby.net/texture/download/[filename].png" if that helps

How can i do this? Ive tried HTracker, but maybe im doing it wrong because depending on the url i try or the settings i try it either finds nothing, or way too much (running for hours, downloading things that arent even what i want yet)

I dont mind some extra website data but its too much from the wrong places. Ive also tried cyotek webcopy too with limited success. Anytime i try and scan a url, it never finds the images im looking for

Maybe im doing things wrong, in which case how should i set this up? maybe im using the wrong tools, in which case what should i try? im aware theres a ton of images hosted on there, i dont mind that, as long as its downloading the right things

I also dont know which url to try and put into the tools. "laby.net/cloaks"? "laby.net/texture/download/"? "laby.net/texture/"? im just not sure

Please help me out here, thanks so much!

The original post: /r/datahoarder by /u/ZiggyJambu on 2024-08-29 22:08:38.

I really appreciate people's help and responses, but I have a follow up question. It seems that no matter which brand or amount paid that there is a physical reason for hard drives to eventually die. In corresponding with someone in the corporate office at Seagate he said that the average life expectancy is 3-5 years. If this is the case, is there any reason (beside cost and convenience) that backing up photos and/or music on SD cards and/or Flash drives would not work and hold up over time. As there is no moving parts, is there a physical reason that these items also will fail over time?

The original post: /r/datahoarder by /u/Sprinkles276381 on 2024-08-29 21:48:11.

Hi! I mostly game so I currently have a single large SSD for my entire system, but it's been a few years and I'm starting to accumulate more and more large files that I want to have a separate space for on a large hard drive (things like TV shows and big PDFs that I can always redownload if needed but are nice to just have around). The only problem is I don't want to trust that to a single drive, no matter how unimportant the data actually is to me. I figured I would just run 2 drives in RAID 1 and call it good, but I thought I would ask to see if anyone has a better solution? Again, I'm only worried about the inconvenience of a single drive failing and having to redownload a lot of stuff which I don't think warrants a NAS

The original post: /r/datahoarder by /u/Gamesarefun97 on 2024-08-29 20:35:44.

I want to digitize my entire dvd collection in order to grantee that I don't lose any of them. I want to make an exact copy of each of the disks and was wondering which program would be the best. I have ample storage so that is not an issue. I've already looked into programs like makemkv, but it seems that it doesn't create an exact copy of the disk. (skipping some scenes)

Any help is greatly appreciated.

The original post: /r/datahoarder by /u/Andreandrya on 2024-08-29 19:42:33.

Okay, help me work out some logic here

I read an external hard drive is only supposed to last 5 years so I bought a new one to back up my original which only gets plugged in from the shelf straight to the computer when I need to empty out my phone of photos so it is very lightly used and not carted around.

So I have copied all the data from the original onto the new one.

Now I am adding new photos.

Just leave the original on the shelf and add things to the new one at this point or now should I be copying all the data onto both? Or should I be taking the original and leaving it in a different location in case we have some sort of fire at our house?

What is a logical and practical thing for me to do here?

What do other humans do

The original post: /r/datahoarder by /u/canrabat on 2024-08-29 19:26:23.

Hello everyone. I'm searching a good Soundcloud downloader and tried many ones which can only access the 128kpbs file, but found two who seems to be able to download higher quality files (lucida.to and soundcloudrips.com). Looking at the files in Spek they do look like they are in higher quality, which it shouldn't be if it was a direct format conversion as we can see in the one I did. Do those websites really access higher quality files or is there other conversion magic at work?

https://preview.redd.it/3kia4z7jmnld1.png?width=1679&format=png&auto=webp&s=25e414f3970bbb71f5b7933df1a542b94a5f37ce

https://preview.redd.it/1k9vq9ujmnld1.png?width=1679&format=png&auto=webp&s=32ad1a9fb383fd6bbd8ce825b73c10adf4691817

https://preview.redd.it/t5la9u9mmnld1.png?width=1679&format=png&auto=webp&s=320dee9fac82953b542a0a88d1d87765b1a9a973

https://preview.redd.it/rtvp06tmmnld1.png?width=1679&format=png&auto=webp&s=67d8df07596fd381a69a68750655cd73c1aeaca4

The original post: /r/datahoarder by /u/Crishbk on 2024-08-29 19:07:19.

Hi All,

I have some DVCPRO HD tapes I need to capture and I want to preserve them properly.

I don't want to use SDI out to transfer them to ProRes or anything like that, I want to capture them natively using firewire, however, I can't seem to find any software that supports DVCPRO HD.

FCP can capture it, but good luck getting it to work in anything that resembles reliable. Sometimes, you start the capture and it appears to be capturing, but once the tape ends, the footage was never captured. Or FCP crashes.

DVRescue works, kind of, with DVCPRO25 but not with DVCPRO HD.

Premiere doesn't even want to acknowledge the decks at all.

Does anyone have any suggestions? Open source or otherwise?

Thanks in advance.

The original post: /r/datahoarder by /u/jdavid on 2024-08-29 18:35:42.

I have been using Resilio for years now and have loved it. It helps us sync and transfer files between our computers, laptops, and mobile devices. I even got it to work on my Meta Quest 3 to transfer files around the home more reliably than any other method I tried, including FTP and Windows/ Linux Networking. It's been simply amazing. Sending videos from my phone to the NAS is amazing. Selective Sync for my Mac Book Pro is amazing for saving storage space on my stingy Apple Laptop. I'm so invested in using Sync at home, it's been great.

But last week, when we noticed that Resilio Sync 3.0 launched, I was both excited and cautious.

Last night I started reading up on 3.0 and wanted to look into if we should upgrade. I wondered what it would take so I could plan ahead and gauge how much effort it would be to upgrade the laptops, pcs, nas, and other devices. I was even using it on a RetroPie at one time to sync roms.

But as I read through the details, it became clear that Resilio was DEPRECATING Docker support.

The FAQ doesn't give a clear answer what that exactly means, and I have been trying to get a clear answer from Resilio Support to get clarity on what that exactly means.

Docker is a very important part of how I use Resilio Sync at home, and I'm not sure if it makes sense to continue using it if it doesn't support Docker.

I have an ASUSTOR NAS, which is similar to a Synology NAS in many ways. The NAS has a built-in Docker container manager that loads the apps you can get from either ASUSTOR or the Synology App Portals. On my ASUSTOR, I also have the Portainer App installed and an instance of the Resilio Client/Server running there, so I can have two different identities syncing at the same time on the NAS.

Eventually, I wanted to move the ASUSTOR instance to the Portainer manager because the docker images are better and more regularly maintained.

All of this now seems in flux until I can get a straight answer on if Sync 3.0 will work or is working inside of a docker container.

• Will Sync 3.0 work in a docker container?
• Is Sync 3.0 working in a docker container env?
• Are there technical limitations preventing it from working in a docker container?
• Are there legal or license restrictions with Sync 3.0 preventing docker usage?

I know that there is a new Sync 3.0 app for ASUSTOR, but it seems unclear how directly it maps to a Pro License 2.x usage set.

Do I need to transition to a different utility? Has anyone else had luck figuring out what this means?

• Is Resilio actively working against people using Sync 3.0 in a Docker environment?
• or is Resilio just moving away from providing official support for Docker environments?

The original post: /r/datahoarder by /u/juzal on 2024-08-29 17:58:55.

I have been looking around to buy a 4TB for first time NAS build. It would be replacing my pi4 but I have really bad time choosing an HDD. I have found WD RED PLUS WD40EFPX but recently I have become suspicious upon realizing that I have already had two 1TB external WD drives that have not lived long enough to consider them reliable enough. I am open to any suggestions. And, I know that one disk without raid is stupid enough, but for now I cannot justify more. Cheers.

The original post: /r/datahoarder by /u/N0Objective on 2024-08-29 17:55:03.

I have a MiniPC with one WD EasyStore 18TB External HDD. I want to expand with either another exact HDD or something close to it. I've been eyeing a couple DAS enclosures but ultimately have settled on the Terramaster D4-300. It will be mainly used for my Plex library. I'm not interested in a NAS setup.

I plan to shuck the EasyStore and use it in the D4-300, but I have a couple questions.

1. Can I simply shuck the EasyStore and plug it into the D4-300 without losing any media?
2. Do the drives have to be the exact same or can I use a smaller/different brand HDD?
3. Is there any options for redundancy with this setup? I know the D4-300 says it does not support RAID but there are other options other than RAID. The media is replaceable but would take ages to recoup in the event of total failure.

Thank you.

The original post: /r/datahoarder by /u/sleepingbeast87 on 2024-08-29 13:54:34.

Hi all, I’m considering buying the Seagate Expansion 1TB External HDD (STKM1000400) with USB 3.0. It comes with 3 years of Data Recovery Services, and I plan to use it for storing family photos and videos.

I don’t have much knowledge about these types of things, so I’m sorry if this isn’t the right place to ask. I’ve read about SMR technology and I’m assuming it should be fine for my needs. I’m also thinking about using AWS Glacier as a second backup. Is that a good choice for my situation? Any advice would be greatly appreciated. Thanks!

The original post: /r/datahoarder by /u/Hungry-Editor6066 on 2024-08-29 13:00:31.

Hi All

Am I right in thinking that the “IBM Spectrum Archive Library Edition” software for LTO drives is paywalled and not available for mere mortal homelabbers and datahoarders to download?

Is anyone aware of a copy, or could point me in the direction of obtaining one (unless, of course, it’s horrendously expensive!).🤪

Are there any open-source alternatives which offer similar functionality? 🤔

The original post: /r/datahoarder by /u/JustMotionDesigner on 2024-08-29 12:24:36.

The original post: /r/datahoarder by /u/nzw_ on 2024-08-29 12:05:43.