It's A Digital Disease!

The original post: /r/datahoarder by /u/ADPL34 on 2024-07-31 13:19:13.

So I am planning to get a 5-bay nas (DiskStation® DS1522+) for my photography and backup storage since I am buying 4tb ssds every year.

I am looking to load the bay with 16tb HDDs (ironwolf pros). How likely is it that 2 will fail at the same time? I can replace one immediately if riad5 fails. raid5 is more storage/£ and modern hhds are good right?

The original post: /r/datahoarder by /u/Utilize3372 on 2024-07-31 13:14:46.

Current set up is (2) 2TB running in RAID 0 giving 4TB of space. Backed up to external 4tb USB drive. The drives are full.

I really don't know what direction to take with upgrading. Budget isn't very high ($400-$500). I have tried the 12tb used enterprise drives from ebay, but the noise on them is too much for me.

Some options?

1.) New (1) 8tb drive in main PC with additional 8tb external drive for backup

2.) New (2) 8tb drives running RAID 1 in main PC with additional 8tb external drive for backup

3.) 4 bay DAS filled with a few used drives hooked up to old PC (noise will still be a factor)

4.) Dedicated NAS with a few used drives (noise will still be a factor)

Any suggestions?

The original post: /r/datahoarder by /u/normaleyes on 2024-07-31 13:11:35.

This is a price question mostly. I'm paying $100/yr for the lower end iDrive Personal plan. I'm using about 1.25 TB, and it's growing at a rate of a few GB a year at this point (for the past 4 or 5 years). It's mostly for archival uses (photos, short 60 second movies, and compressed music files). In the past year I haven't even updated what's online, probably haven't logged in either, but it's important to know that the files are safe.

I used to use amazon glacier with the FastGlacier client, but it didn't feel like a good solution for someone who only touched these files once or twice a year.

I feel like I'll want to maintain these archives for another 20-30 years, and at that point I'll be too old or feeble to care. Should I keep sucking up $100/yr, or is there another alternative, like a local cold storage solution (for very little disk space) that might be a 1 time cost, then it just works. What getting a synology type box and turning it on once a year (kinda like starting up that generator you keep in your garage).

The original post: /r/datahoarder by /u/Kamihasawoken on 2024-07-31 12:47:20.

My old laptop is starting to shut down, and so I was going through the process of backing up all my important files on the cloud just in case it died on me. I use Onedrive with the 1TB storage, and I just realized how little storage onedrive actually had once I started to hoard files.

So I got to researching external hard drives and SSDs, which one might be best, what brand, etc.

My problem is that a lot of the photos on onedrive are my childhood photos and family photos my parents had in a hard drive that I happened to find one day before they were accidentally thrown out. My parents want to access them randomly some times so I need them to be able to access the files themselves without going through me.

I wanted to create a large pile of hard drives divided into family photos, personal files etc that I can keep in storage and access when I need it. My worry is that my parents aren't that tech savvy, so they might not be able to use it without me. I'm going off to university soon, and I won't always be there to help them out in case of trouble.

In this case, would it be better for me to get hard drives for myself and have a secondary cloud storage just for my parents so they can access it easily? I would prefer for it to be in a hard drive so I don't have to worry about maintaining two methods of storage, and if there is a way to make the hard drives accessible as possible, what would it be.

The original post: /r/datahoarder by /u/Necessary-Football81 on 2024-07-31 10:44:19.

The original post: /r/datahoarder by /u/C6180 on 2024-07-31 10:37:39.

I saw on a post from a long time ago that someone was able to retrieve videos directly since they couldn’t play them on the site. I was wondering if anyone knew exactly what this method/trick is since a video I’m trying to play/download to my device so I don’t lose it again isn’t playable on the website and got removed on YouTube due to violating TOS. I also can’t tell if they mean the inspect console or something else

The original post: /r/datahoarder by /u/invisibleboogerboy on 2024-07-31 10:01:27.

I've come across several topics where people mention the 3-2-1 rule and say something about saving to multiple types of hardware like hdd, disc and "tape"... what do they mean by this? What is tape exactly? Are we talking like cassette? VCR? Betamax?

The original post: /r/datahoarder by /u/AudioThousand on 2024-07-31 09:11:21.

Hi!

I own a Lenovo ThinkBook 16 G6 (21KH0017MX) with a WD PC SN740 SDDPMQD-512G-1101 M.2 2242 NVMe SSD in it. I’ve just purchased the Samsung 990 Pro SSD - 2TB to use in the second slot, but then it dawned upon me: 

Should I reinstall Windows on the new drive, and use that as the OS-drive?

First of all, is it possible in a pre-built laptop from Lenovo to do that? Like install Windows with the Media Creation Tool, if you don’t have a product key (since it came with the laptop)?

Second of all, will there be any noticeable differences in day-to-day life? I’m currently solely using the laptop for music production - so I planned on using the extra storage to load my virtual instruments (VSTs) and save my recordings, while keeping anything else on my OS-drive (programs, plugins etc.)

Any thoughts/opinions on the matter would be deeply appreciated!

The original post: /r/datahoarder by /u/Pasta-hobo on 2024-07-31 07:17:32.

www.stopkosa.com

KOSA, the Kids Online Safety Act is an internet censorship bills that intents to place the majority of online services behind an ID verification wall in the name of allegedly protecting children.

I'm posting this here since I know you will care about it.

The Internet is not a broadcast medium like TV or Radio, and should not be legislated as such. It's a method of communication, the likes of the telephone, fax machine, and postal service. Censoring the web is the same as censoring any of the above.

I'm certain that data hoarders of all people are in favor of a free and open Internet, so please, make some noise! Call your representatives, write emails and letters, and above all else, spread the word!

Otherwise, the Internet we see may become as information poor, watered down, and heavily censored as basic cable TV. Not to mention the numerous phishing scams that would occur with the ID verification requirement.

Not to mention how this would harm children, minority groups, women, all by restricting access to the information they can access.

Seriously, my friends, make some noise!

As I'm sure you're well aware, information is a powerful thing, and knowing is always half the battle. Make sure everyone can have access to the information they need to fight their battles.

Save the Internet

www.stopkosa.com

www.badinternetbills.com

The original post: /r/datahoarder by /u/SamVimes341 on 2024-07-31 07:08:37.

My qnap died and I’m trying out zfs with samba on an lxc with proxmox. The problem I have is about 3TB of small files (photos) on a usb that I want to copy over to a 2 drive mirrored dataset. rsync is extremely slow. About 75GB copied in 24hrs. Any suggestions?

Also have been spoilt by a decent file manager that showed progress in qnap. What’s the best way to monitor progress? Thanks in advance.

The original post: /r/datahoarder by /u/dark__mode on 2024-07-31 05:35:16.

The original post: /r/datahoarder by /u/SirBurtonofCamelot on 2024-07-31 05:14:35.

Is there a way for me to rip this video? I know how to rip YT vids, but this is off from somewhere else and I don't know how to collect it.

https://www.military.com/video/law-enforcement/police/korean-riot-police-ancient-tactics/3122639958001

The original post: /r/datahoarder by /u/Halocorn on 2024-07-31 03:32:18.

Hello all, I'm a Plex media data hoarder. I am have a Plex Server that is hosted at a friend's house (they have the upload I don't) I currently have an off-site backup at my house with remote sync of content setup as some of the content I have was not easy to acquire.

Starting to get costly to get hard drives that are essentially just sitting idle. I've got roughly 120TB and adding about 20TB a year. Which basically means purchasing 2 20TB each time I need to expand the media Library.

I know the drives are the most expensive part so the initial cost is high, but expanding it is cheaper. Would LTO5 be worth doing?

I would then be able to move the hdds to the media server for future expansions.

The original post: /r/datahoarder by /u/Transposer on 2024-07-31 02:07:08.

What are the odds that two two-month old Western Digital drives die at the same time? Is there a reason this might happen? Tried two different external dual-bay drive bays and neither want to mount. Occasionally, I can get one to mount, but rarely.

What might have caused this? Power outage burn them out? Any tips or tricks would be greatly appreciated.

The original post: /r/datahoarder by /u/LinuxIsFree on 2024-07-31 00:03:51.

I thought I found a good answer online but I cant find the page anymore.

I want to have an offline copy of all the packages in apt-get for ubuntu or debian so I can set up servers and software without internet access. Certainly for amd64, but ideally for arm64 as well.

I cant find a clear answer on if apt-mirror does that, or of it's the installation images for Ubuntu.

I need to know what size disk Im looking at needing, and I need to know what commands to use.

I have a ton of small 256gb SSDs, would it be possible to maybe split it alphabetically across some SSDs so I can just plug it into a system and install it from there?

Sorry if this is a stupid question, I just dont understand the answers Im finding

The original post: /r/datahoarder by /u/ROMANREIGNS599 on 2024-07-30 23:43:28.

Hi, hope you are doing well. Back in around 2016, I made 2 MEGA accounts. I forgot I already had an account (one that I want to use now), thus, created another one. I know the other account's email address. 

I forgot I even had that other account until now. I don't know the password and I did not save the backup key. I want to delete that account so that I am not going against the terms and conditions of MEGA

The original post: /r/datahoarder by /u/Squellbell on 2024-07-30 23:30:49.

I am trying to copy all my captures from my PS4 to USB. My PS4 states I have 332.4 gb of data for captures. I go to All (both Screenshot and Video) and then Select All to copy to USB. When I open the folder in my USB on PC, the total data size is only 311 gb. I've done this transfer three times now and everytime there seems to be missing data, but it's exactly the same size on disk (311 gb) and I can't figure out why it won't copy that remaining 21.4 gb. Any suggestions ? As far as I can tell there is not really any info out there as to why this may be happening.. TIA!

Edit: For more info- I have PS4 Pro, the USB is ExFat and has plenty of space (4tb), other users' captures are all showing in the same place so it's not someone else's account captures.. that's all I can think that will be relevant

The original post: /r/datahoarder by /u/_cant_talk on 2024-07-30 22:00:47.

I’m looking at buying 2x renewed 18tb seagate nas drives off Amazon for $175 each and running them in raid 1

I’m not looking to run it 24/7 just need about a 20tb backup for video projects

I’ll eventually get a real nas when I need/afford it

Or should I keep buying the $100 8tb drives individually and archiving on those?

The original post: /r/datahoarder by /u/red____- on 2024-07-30 21:52:06.

Looking for hdds for my jellyfin server and was wondering if this newegg deal is worth getting https://www.newegg.com/hgst-western-digital-ultrastar-dc-hc530-wuh721414ale604-14tb/p/1Z4-0002-01N48 or if i should buy a new /another one. thanks

The original post: /r/datahoarder by /u/ericlindellnyc on 2024-07-30 21:47:46.

I ran rmlint on a local folder to find just duplicate directories, using command rmlint -vxgbe -T "dd" It reported files and duplicates as follows: In total 81982 files, whereof 18446744073709544613 are duplicates in 8073 groups.

The number of duplicates is an astronomical product of the number of files.

Because I have little experience with rmlint, I'm leery of using it on a 5TB folder until I've ironed out the kinks.

Assistance appreciated !!

BTW, here's the full terminal session.

bvi1434:~ ericlindell$ cd /Volumes/14tb-2nd/searchable/DDD-TO-DIST-EEEEEEEEEEEEEEEEE/archivePrbly/DepthFr-7p31/depthReduced/DepthEtc-depth41/depthPartialCopyFrCopy bvi1434:depthPartialCopyFrCopy ericlindell$ rmlint -vxgbe -T "dd" ▕░░░░░▏ Traversing (81982 usable files / 0 + 0 ignored files / folders) ▕░░░░░▏ Preprocessing (reduces files to 60054 / found 0 other lint) ▕░░░░░▏Matching (44858 dupes of 15175 originals; 0 B to scan in 0 files, ETA: ▕░░░░░▏ Merging files into directories (stand by...)

==> In total 81982 files, whereof 18446744073709544613 are duplicates in 8073 groups. ==> This equals 74.87 MB of duplicates which could be removed. ==> Scanning took in total 26.128s.

Wrote a sh file to: /Volumes/14tb-2nd/searchable/DDD-TO-DIST-EEEEEEEEEEEEEEEEE/archivePrbly/DepthFr-7p31/depthReduced/DepthEtc-depth41/depthPartialCopyFrCopy/rmlint.sh Wrote a json file to: /Volumes/14tb-2nd/searchable/DDD-TO-DIST-EEEEEEEEEEEEEEEEE/archivePrbly/DepthFr-7p31/depthReduced/DepthEtc-depth41/depthPartialCopyFrCopy/rmlint.json bvi1434:depthPartialCopyFrCopy ericlindell$

The original post: /r/datahoarder by /u/Consistent-Signal617 on 2024-07-30 21:30:20.

Hello everyone, I'm currently creating an image of my 500gb HDD to transfer to my 240gb SSD. But I have some questions.

While only 190gb of the 500gb space is used, the internet says it will cause problems, because the partition doesn't get automatically shrunk to match the SSD in total capacity.

I learned after starting the imaging that you should start with shrinking the partition on the HDD first. The progress is currently on 20% and I'm not sure if I can safely abort the progress. Or if it's possible to shrink the partition of the image it creates afterwards.

What should I do?

The original post: /r/datahoarder by /u/25QueenSt on 2024-07-30 20:48:35.

Hello fellow hoarders, Does anyone know why my Samsung won’t recognize some (but not all, it’s very baffling) files that contain entirely legally-owned movies? Is it a problem with the PASSPORT WD one? Cause I’ve had no problem before switching from an intenso drive

The original post: /r/datahoarder by /u/Merwenus on 2024-07-30 20:28:29.

Since I bought my N6005 board, Topton came out with multiple N100, N305, i5-12450H boards on aliexpress, but they somehow hide informations about SATA port speeds.

I have 6 sata ports and use 4 of them, but they seemed slow, and found out Topton sometimes uses a slow PCIE3 x1 connection speed, totalling a whopping 128MB/s speed for sata ports making my 250MB/s seagate drives totally useless.

After upgrading my camera setup from 4 to 8 cameras in Frigate, the CPU does not seems to be enough (coral AI+GPU accelerators and CPU are around 95-100% usage), and there will be an additional doorbell camera in a a few weeks, so it is time to upgrade.

aliexpress.com/item/1005007028901524

This i5-12450H CPU and newer GPU should be enough, and the M2 NVME with PCIE 4x4 would be a dream come true, but I can't find any information about sata port speeds and I really don't want to bottleneck my Seagate Exynos drives again, does anyone have information about this, or can suggest a different board in this price category?

I use 1 USB2.0 for Zigbee, 1 USB3.0 for external HDD, 1NVME for Western Digital NAS SSD (PCIE4x4 would utilize its speed fully) and 1 NVME for Coral AI (this can be slower), 4 sata ports with 250MB/s. Also I would use 2 2.5gbps ports in Proxmox as a switch (my PC and router)

The original post: /r/datahoarder by /u/Merwenus on 2024-07-30 20:26:12.

Since I bought my N6005 board, Topton came out with multiple N100, N305, i5-12450H boards on aliexpress, but they somehow hide informations about SATA port speeds.

I have 6 sata ports and use 4 of them, but they seemed slow, and found out Topton sometimes uses a slow PCIE3 x1 connection speed, totalling a whopping 128MB/s speed for sata ports making my 250MB/s seagate drives totally useless.

After upgrading my camera setup from 4 to 8 cameras in Frigate, the CPU does not seems to be enough (coral AI+GPU accelerators and CPU are around 95-100% usage), and there will be an additional doorbell camera in a a few weeks, so it is time to upgrade.

https://www.aliexpress.com/item/1005007028901524.html

This i5-12450H CPU and newer GPU should be enough, and the M2 NVME with PCIE 4x4 would be a dream come true, but I can't find any information about sata port speeds and I really don't want to bottleneck my Seagate Exynos drives again, does anyone have information about this, or can suggest a different board in this price category?

I use 1 USB2.0 for Zigbee, 1 USB3.0 for external HDD, 1NVME for Western Digital NAS SSD (PCIE4x4 would utilize its speed fully) and 1 NVME for Coral AI (this can be slower), 4 sata ports with 250MB/s. Also I would use 2 2.5gbps ports in Proxmox as a switch (my PC and router)

The original post: /r/datahoarder by /u/Relative_Maybe_2013 on 2024-07-30 12:53:31.

How can this image be downloaded at full resolution? When I open the image and try changing the resolution in the URL, I can only down scale it.

Image: https://www.artic.edu/artworks/118735/the-certitude-of-the-never-seen