It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
8901
 
 
The original post: /r/datahoarder by /u/vankroven on 2024-06-22 18:29:04.

Someone challenged me to download a video file on their website. I tried the usual getFLV / yt-dlp tricks but the mpd file I generate redirects to bad requests.

MPD link:

https://edge-b.video-crypt.com/44817283-8266-4fc6-9e4c-cc083986a809/widevine/h264.mpd

The website where the video is:

https://bmdrm.com/en/home

I would appreciate any feedback or directions!

8902
 
 
The original post: /r/datahoarder by /u/nlj1978 on 2024-06-22 18:21:04.

Got started last week ripping my CD library to my home server. Today my data drive has disappeared from windows.

Drive is from GoHardDrive. Bought 2- 10tb drives. One arrived DOA, they sent an RMA for it. This one tested good and has been fine. I was using an old sata cable I had laying around. Swapped it out for a new one and no change.

Upon startup I can hear the drive spinning up and reading or whatever but it has dissappear from the computer. I'm going to try a different sata port on the mobo next.

What else should I be trying?

8903
 
 
The original post: /r/datahoarder by /u/jankies11 on 2024-06-22 17:33:03.

Is shucking external hdds worth it in 2024? How do easybook or my wd etc external drives hold up to wd red pro’s or iron wolf pros?

Specifically looking at 18-22TB I figure for longevity and the lower (12-16) TBs don’t offer much savings on $/tb last I checked…

Trying to resist any buys until the thanksgiving time of year but are there other major discounted times of the year?

8904
 
 
The original post: /r/datahoarder by /u/HugeFrog24 on 2024-06-22 17:08:04.

Currently rocking a QNAP TVS-h874 with 2x WD Red Pro 24 TB mirrored as RAIDZ1.

As I work on developing a robust backup strategy for my NAS, I wonder if QNAP offers a native solution that allows splitting backups across multiple external drives automatically, without manually dividing my directories into chunks of 4 TB each.

The rationale is that a 24 TB backup cannot fit on a single 4 TB external HDD. This becomes even more apparent if I expand to a usable 144 TB in the future. In that case, it would be impossible to find a single 144 TB external drive, as such drives simply do not exist.

So, is it possible to distribute backups across multiple external drives using QuTS hero 5? How exactly?

8905
 
 
The original post: /r/datahoarder by /u/mrearthpig on 2024-06-22 15:54:12.

Hi everyone,

It's come to that point where I need to simplify things so I can actually get other things done. Up until now my backup routine has been a mashed up mess based on chopping and changing how I have done things over the last decade or so. My current setup is as follows:

My PC contains:

500Gb system drive. (C:)

2TB backup drive. (D:)

2TB drive which contains photos, documents, a few games, some program files, user profiles, and other random content. (E:)

1TB games drive. (I:)

I have two NAS systems. A Synology with 2 x 4TB drives set up as RAID1, and a ReadyNAS with 2 x 3TB drives set up as RAID1.

The ReadyNAS contains TV shows and movies. Probably stuff I'll never watch again, but meh, whatever.

The Synology contains a system image of C: and E:. I create a Windows system image using Backup and Restore whenever I remember. I only do this as I've lost a system drive before, and rebuilding from scratch, trying to remember what was installed, was a complete nightmare.

I use Duplicacy to backup everything else important to me. Photos, documents, tax stuff, videos and projects the kids have made etc. I store a copy of the Duplicacy backup locally on D: and upload a Duplicacy backup to OneDrive.

My requirements:

  1. Ensure I have backups of everything I need to keep that is important to me and my family. (Photos, documents, etc). I really need to make a hard copy of instructions about where and how everything is stored so that future access to this stuff is easy for the rest of the family, but that's a problem for later.
  2. A low maintenance schedule. At the moment things are relatively simple, but they just seem messy. I run the system image backup when I remember and Duplicacy takes care of the rest.
  3. Ensure I have system backups so that I can rebuild in the event of a drive or complete system failure.

So, what am I asking for? I guess I'm wondering if there's a better way to do this. Should I move all of my important data off of the drives in my PC and onto the Synology, then have that backup to OneDrive? Would that remove the need to use Duplicacy? In the event of corruption of the files on the NAS and being upload to OneDrive without me being aware, what then?

Any advice or thoughts appreciated.

8906
 
 
The original post: /r/datahoarder by /u/retrac1324 on 2024-06-22 15:03:31.
8907
 
 
The original post: /r/datahoarder by /u/seannymurrs on 2024-06-22 14:25:59.

I'm looking to get a 4TB SSD to put in my Satechi hub that connects to my M1 Mac mini via USB-C (link to exact hub here in case it matters). The drive will be used to supplement the built in storage on the Mac mini, and it will mainly be used as the storage device for things like my photo library and other large libraries/files.

I did a quick search on Amazon, and I can get a Samsung 990 Pro for $340, but I also see a WD Black for $309 or Crucial P3 for $216. It's been a while since I've bought a storage device, but I recognize all three brand names. For my purposes, is there enough of a difference between either the WD or Samsung to justify the price difference over the Crucial?

Thanks in advance to anyone who can offer some guidance/assistance.

8908
 
 
The original post: /r/datahoarder by /u/true_head on 2024-06-22 13:41:23.

My HDD suddenly died and shows no sign of working even after connecting the SATA cable, it is not recognized at all on Windows and changing the cable does not work. It's a WD blue model that I just bought last year. Is there anything I should try before I throw this thing out the window?

8909
 
 
The original post: /r/datahoarder by /u/A3-2l on 2024-06-22 11:45:22.

Hello, I've been a part of this community a good while, and have dabbled in all sorts of ways to store my data. DIY NAS', RAID arrays, etc. I'm a university student, and while I'm at school, I won't have access to all my systems which store my data.

I'm looking for a good way to make a lot of copies of important documents which I would hate to lose. Let's say that the total volume of data is probably around 100 GiB or so. the largest file is likely somewhere between 5-10GiB.

I have heard that Blu Ray discs are good for long term storage, and they seem like something i could easily make copies of to keep in multiple locations. My PC currently has a slot for an optical drive. And while it is currently being occupied by a DVD/CD drive, I am willing to pay some good money for one that supports Blu Rays.

My two main questions are:

  1. Are Blu Rays the way to go for storing important data that I won't need to modify, and for a long time?

  2. Could I get a decent Optical drive and Blu Ray discs for $150-200?

Sidenote:

With some research into Blu Ray drives, a whole lot of makemkv and ripping discs comes up. I am aware that some drives are capable of buring/ripping in UHD, and some need firmware flashes, and some are incapable of firmware flashes. Burning/ripping 4k is not a concern of mine. I do burn movies, but 99% of what I do is in FHD. Data backups are all i am worried about,

8910
 
 
The original post: /r/datahoarder by /u/Over_Variation8700 on 2024-06-22 10:28:29.

So I have around 150 of these 4K video files with a bit rate ranging from 40 to 70 megabits per seconds and each file being exactly 4GB. However, I don't really need them to have the highest quality possible as they're all screen recording files but I might need them in the future. Would it make any sense to transcode to better format and reduce file size? 13700KF CPU+4070Ti GPU

https://preview.redd.it/if5mtqi7n38d1.png?width=816&format=png&auto=webp&s=10cd83c668700543fb24c80f1147dc2031d71978

8911
 
 
The original post: /r/datahoarder by /u/freshairproject on 2024-06-22 10:24:09.

Which LTO6 drives do people usually recommend for Windows 11? I have 20tb that I’d like to back up in addition to other sata drives. Do used tape drives go bad? Like does it have a certain amount of writes before the magnet goes bad?

8912
 
 
The original post: /r/datahoarder by /u/PRINNTER on 2024-06-22 09:37:13.

I am in possesion of a samsung pro ultimate 256gb microsd, And it was unused, so I am in the process of downloading entire wikipedia in my native launguage (polish) with every picture/video and audio file included and hosting it online.

My questions are:

  • Is a microsd that stays plugged in and isn't unplugged/plugged back in good enough for a read only sceniario? (so the pins on the microsd aren't wearing out)
  • Are there any implications, like "after reading x gb from a microsd it will just stop working"?

Note: I am aware, that wikipedia has already many mirrors hosted online, but It's a learning experience for me (both on data hoarding and programming because I need to write code to host the copy of wikipedia online).

8913
 
 
The original post: /r/datahoarder by /u/celexaprozac on 2024-06-22 08:13:38.

I have a 5TB external Seagate One Touch Rescue Edition that's just sat on top of my tower PC for as long as I've had it as my primary backup method, obviously insanely important materials are still in the cloud or spread across numerous flash drives. However, having only one backup copy of my shit is not a recipe for success. Having one is as good as having none as I like to say, redundancy is crucial when it comes to hoarding my data. Important pictures are backed up, the most important of which are printed out.

My consideration here is whether or not I get a high capacity internal HDD @ 7200 RPM or if I buy a high capacity portable HDD that can take abuse and is less likely to be damaged by physical adjustments and movements. This is rarely a concern in my day to day but I live in an earthquake prone area and I would agonise over losing everything to some shaking dirt.

I can't do both due to financial constraints at the moment but the decision is as follows;

Do I get a second external USB HDD that will be slower and have inferior transfer rates BUT be more protected in event of disaster and any other events that may happen (dog with zoomies for instance.)

or

Do I get a more efficient and practical internal HDD (I imagine its also cheaper) that I suspect to be significantly more fragile and susceptible to sudden movements and will likely be lost in the aforementioned events.

If the internal is selected, should I acquire this before the sale ends? If I should go with an external what should I acquire? I'd like something larger than my current 5TB. I haven't used more than 1.1TB on it but I'd rather kick the can of running out of space a few more years down the road.

8914
 
 
The original post: /r/datahoarder by /u/DrWho345 on 2024-06-22 08:11:19.

When Samsung and WD drives start acting up, it will be working for ages, then one day, it will be connected as usual and then, no matter what you do, it won't mount, you can feel it running in your hands, but nothing shows up on your computer, you disconnect, reconnect, try to mount it via command/terminal absolutely nothing is working... what are your strategies/next steps?

I have a few that have died/stopped working? and don't know what to do now.

I have a Mac by the way, and an Windows 11 NUC running MacDrive, I have connected the drive to both, and have had nothing at all.

Edit: when I connect it, I can feel it running when I touch it, but it doesn’t mount at all, I can’t backup anything because I can’t see anything when it is connected.

8915
 
 
The original post: /r/datahoarder by /u/09Klr650 on 2024-06-21 22:55:50.

Purchased (2) 12TB drives from serverpartdeals.com. Just one would hold everything I have in a motley collection of drives. Impressively they came WITH both a pin3 disabled power cable AND a card with a little kapton tape and instructions. As I am using a Sabrent 5-bay (eBay find, decent price for a non-raid external) I used the tape to disable the pin3 reset. Discovered I need to cut back on the caffeine as my hands were shaking WAAAY to much to make that easy. But it is up and running. Figure I will run these two as regular or raid 1, then once I order two more go raid 5. Now to spend some of the weekend using an external SATA dock to try to reclaim files from a stack of old bare drives, then my misc external drives. Suspect this will take a while.

Now to research software raid programs . . .

8916
 
 
The original post: /r/datahoarder by /u/SamTheManBrown on 2024-06-21 22:22:44.

I’m helping a friend who recently lost her husband, back up and consolidate all his data. He’s an editor so he had a lot of computers around the house but luckily he had work computers that I don’t have to worry about.

She wants me to just buy a big drive and copy everything from each computer onto the drive. I’m pretty tech savvy but I know it’s going to be a little bit more complicated than that.

I have 3 questions:

  1. Is there a good guide on the best way to about this as far as, using a drive… cloud… blu-ray.
  2. Is there a good step by step guide on how to do this?
  3. What brands do most people recommend?
8917
 
 
The original post: /r/datahoarder by /u/tamashika on 2024-06-21 21:42:00.

I need help to understand the policy of mergerfs to better fit my needs. I'm using a free cloud storage that does not let a user to have multiple free accounts. I think limiting the log in time would make my accounts less likely being detected, especially not logging in at the same time. I have checked that rclone union would have to log into all accounts when something is being transferred. I wonder if mergerfs also has to do the same.

The reason I thought we don't have to log in to view the content is based on the idea from Virtual Volume View (VVV), which catalogs the content of removable volumes like CD and DVD disks for off-line searching. Would like to know if mergerfs could do the same or similar thing.

Thanks.

8918
 
 
The original post: /r/datahoarder by /u/ShyGuyGaming76 on 2024-06-21 21:00:11.

I've been trying to archive a lot of podcasts from Spotify, however most things like spotifymp3 and spotdown don't work for a lot of episodes of them in particular, and just give an error. Is there a better way to convert them?

I started doing this by just screen recording them, however that's extremely slow, both screen recording the podcast and putting it through a conversion application.

8919
 
 
The original post: /r/datahoarder by /u/ThisRaYaN on 2024-06-21 19:19:11.

Good morning fellas. I wanted to upgrade my laptop ssd from 256gb to 480-500gb(1000gb is not interested because i'll buy a new laptop next year. And sata m2's are like too old to use right now). The reason is to install Linux and try to use it without any data(I'm 5th year Graphic Design student. Wanted to fully transfer to Linux and to try it for Design niche).

So here is the deal. NEW WD Red SA500 70$ vs NEW WD Green WDS480G3G0B 64$ vs WD Green WDS480G2G0B 64$ vs used(i'm not sure) Samsung EVO 870 500GB 58$.

Samsung is not making EVO 870 for years now. So i'm sure it's not new. Right now I'm using Crucial Micron 1100. Read 525 Write 431. WD Red is for Nas so i heard they have bad write speed. But there is like no blue in my country to use. I don't want Crucial MX500 because it's 1000gb and 137$ too out of my budget. Can you help me?

8920
 
 
The original post: /r/datahoarder by /u/Mooman5 on 2024-06-21 19:01:44.

Hey everyone I’m currently trying to get the LSI 9207-8i to work in my home unraid server. I’m using it with 4 hba 4tb hdd’s, and I’m having a lot of trouble. The card is detected in my bios and in unraid. I’m using an asrock b560m-c motherboard. This is my first time trying to make any kind of server, so please have mercy on me. Any advice is greatly appreciated.

8921
 
 
The original post: /r/datahoarder by /u/LauraAmerica on 2024-06-21 18:18:08.

Should I keep my NAS and server on all the time?

I know that I should, but it's a bit complicated.

My NAS is for storage and my server is for services (duh!), but I rarely use them. I need a file from my NAS less than five times a month (I get most of my stuff done on the cloud; my NAS has a backup of everything), and I use Plex probably twice a week.

I've tried keeping them on at all times, but the weather is too hot here (around 40°C indoors), there's no AC, and I have terrible airflow. So I'm worried about overheating. I've already lost some good companions this way, like my Alienware laptop, which during its last days would hit over 100°C within 30 seconds of booting up and start screaming in pain (critical beeping). AC is not an option here; all I can do is get huge fans all over the house (I have so many already, but they only move the hot air; they don't cool it down).

What I've been doing for the last few months is turning on my NAS and server when I need them, doing what I have to (plus backups if convenient), and then shutting them down.

I'd like some advice. What's going to kill my servers first, the spin-ups or the heat?

And, what would you suggest to do in my case?

Thank you!

Server:

LarkBox X (N100)

NAS:

QNAP 231 with industrial-grade HDDs

8922
 
 
The original post: /r/datahoarder by /u/JSP62 on 2024-06-21 18:11:15.

I recently acquired (3) 1tb Dell Constellation2 2.5" hard drives, but they are all SAS connection type.

I understand I cannot use SAS drives in a normal PC setup and can only use in a commercial enterprise settings with multiple drives, correct? From what I've read, it's 2 different types of interface between SAS and SATA.

I was hoping to use the SAS HDDs as spare drives for gaming consoles, but I am afraid it will not work in this situation will it? Are there any options for me to utilize these drives or did I pretty much buy paperweights that are of no use to me? If so, the best I can hope for is that someone else can use in a RAID setup and I can recoup some costs?

Thanks for you input!

8923
 
 
The original post: /r/datahoarder by /u/LOGWATCHER on 2024-06-21 17:46:02.

I've been reading a lot about those lately, and it seems that there are either super expensive options, or super cheap ones that will destroy your computer in a blaze of fire.

I'm looking for a pciE card that will take 2 to 4 nvme drives, with the PCIe Bifurcation support built on the chip, as the computer's bios won't support it.

I'll be using it on a proxmox setup.

I was looking at the GLOTRENDS PA20 , but .. It seems controversial.

8924
 
 
The original post: /r/datahoarder by /u/Sinnagangsta on 2024-06-21 16:24:30.

Hi all

So I am setting up a RAID5 NAS and I have 3 4TB drives and 1 8TB drive. No hot spare drives. According to a RAID calculator, I will only have 12TB of usable storage, and it says 4TB is unused. This is consistent in the NAS panel, it is showing just under 12TB, why is this? Is that 8TB drive a waste, or am I missing something?

https://preview.redd.it/b851t2bway7d1.png?width=1936&format=png&auto=webp&s=4a4b4798deb005afe3eb0b5978937c24271fd593

https://preview.redd.it/p7soc3bway7d1.png?width=1440&format=png&auto=webp&s=34a904c6d75d1617a1df6637c759a64f5db475e9

https://preview.redd.it/44fhp3bway7d1.png?width=1438&format=png&auto=webp&s=7244a7e0e80f65fb40de24f36c320c9d8408d60a

8925
 
 
The original post: /r/datahoarder by /u/gerdude1 on 2024-06-21 15:51:47.

Hi,

I have a few mini pc's (I have a decent size NAS as well) and would like to create CEPH storage, which requires three nodes on ProxMox. Hence I am looking for recommendations for a somehow inexpensive SSD's that have decent endurance (NVME is already used on all three Mini's, but they all have space for 2.5 SSD and a SATA port available). I am in the US and see price points of ~$120 for QLC and $150 for TLC. I have access to Microcenter, but there is very little available and newegg has all the usual suspects available (e.g. 970 Evo Plus).

Would love to hear about some recommendations.

Thanks in advance.

view more: ‹ prev next ›