It's A Digital Disease!

The original post: /r/datahoarder by /u/myevit on 2024-07-04 22:32:58.

The original post: /r/datahoarder by /u/Vladimir_Djorjdevic on 2024-07-04 22:07:30.

Hi, so I am looking to build a nas from my old pc and I've noticed that some enterprise drives are basically half the price of NAS drives.

The drives I was looking at are:

SEAGATE ST12000NM0127 12TB for ~$156 and

WD Ultrastar HUH721212ALE601 12TB also for ~$156

For comparison aside from these the cheapest 12TB drive is a Seagate Ironwolf Pro for ~$338. The closest drive price-vise is a 6TB WD red drive. Those 2 12TB are in a price/GB league of their own and no other drive comes even close. All of them are unopened and from the same retailer, and I converted the prices to USD

So why are these so much cheaper?

The original post: /r/datahoarder by /u/thelectroom on 2024-07-04 20:25:29.

Was running out of SATA connectors in my computer so decided to put a LSI HBA flashed in IT mode in there. The computer boots fine and functions normally until it goes to sleep. When the computer wakes up, I notice that my webcam/other accessories are no longer detected (rear USB ports). Also, it functions for a bit before crashing.

I've isolated the behavior to the HBA by disconnecting all accessories and attempting to wake from sleep... Found some older threads discussing Fast Boot setting should be disabled, but no luck with that. Any ideas how to rectify this?

I feel like the issue is something around:

1. HDD's (x6) spinning down and then spinning up when we come back from sleep
2. Something about the HBA not liking sleep/wake and crashing

The original post: /r/datahoarder by /u/feramance on 2024-07-04 17:48:55.

I've been lurking this subreddit for a while now and I see so many people recommending where to get drives at a good price (serverpartdeals) however I haven't seen any good places located in the EU.

The cheapest 8tb drives I can find go for 180-200 after shipping, and higher capacity drives seem to simply be more expensive, not necessarily by much but still. I've taken a look at ebay however, the lower priced options (130-140) seem sketchy at best.

Any trusted suggestions? Thanks

The original post: /r/datahoarder by /u/feramance on 2024-07-04 17:44:28.

I've been lurking this subreddit for a while now and I see so many people recommending where to get drives at a good price (serverpartdeals) however I haven't seen any good places located in the EU. Any trusted suggestions? Thanks

The original post: /r/datahoarder by /u/erictheauthor on 2024-07-04 16:01:03.

What the title says. I need to download this video but all of the websites and extensions I tried do not work with this website. I was only able to download a 9 second clip.

Do you know how I can download it? (I don't want to screen record).

Edmond Author Shares New Book About Kindness On The Porch (news9.com)

Thanks!

The original post: /r/datahoarder by /u/Traeonna on 2024-07-04 15:03:28.

Since the newest updates, I can no longer use the Right Click > Inspect > Network tab > search "m3u8" method of sourcing the URL I need for downloading the videos (I used VLC in the past to do this).

Does anyone know how to download videos from crowdcast (AS OF May 2024...I've tried all the other old methods of doing this...none work).

Thanks!

The original post: /r/datahoarder by /u/alanwarner88 on 2024-07-04 14:55:16.

Hello I am having a problem, I just discovered that the Crucial mx500 SSD that is not more than 2 years old has 7 % of life expectancy left and I don't know why, when looking at how much was written it has 125TB and I don't know why, its used for windows and some heavy games but nothing else, I don't know what happen and made it write so much in such a short time, why do you think what happened and what can I do about it? i did the math and i shold write around 200gb in the time i have it each day to be in that state, so basicle imposible for the use i give to it (sorry about my bad english)

https://preview.redd.it/b7jyfeb1niad1.jpg?width=837&format=pjpg&auto=webp&s=e5ff15c0d0f3bce26e4bf41428e56e7941f73a67

The original post: /r/datahoarder by /u/BlueSkull on 2024-07-04 13:35:51.

Long story short, I'm looking for a cheap NAS solution that can potentially saturate a bonded 2x 10Gb SFP+ link (with 4TB NVMe, not essentially necessary when accessing from spinning drives).

I will also need the very machine to link a few VLANs, so it must be running Linux and be capable of doing NAT and OpenVPN (not at 10Gb though, maybe 2.5Gb at most).

I'm thinking if I can use an R86S Pro with a (few) USB DAS attached to it. But I do have a few concerns beforehand:

1. The CPU it sports, i3-N305, has no ECC support. With only on-die ECC of LPDDR5 (but running slow, I think the CPU supports only up to 4800MT/s, so link-ECC is highly unnecessary), will this be reliable enough for a NAS? I will NOT be running zfs or anything with a huge memory cache. Also, some say it is as powerful as an E5-2670v3, so not bad at all.
2. The DAS shall have 5 bays. It could either be USB3.1-->USB3.1 to SATA3-->SATA3 RAID-->5x SATA3 or USB3.1-->HUB-->5x USB3.1-->5x USB3.1 to SATA3-->5x SATA3. Since I don't plan to do zfs or unraid, I'll just go with RAID5, it doesn't matter if I go with HW RAID or SW RAID. With the former route, the single SATA3 link between USB and RAID would be the bottleneck, capping things to some 550MB/s. With the latter route, the host PC would have to address multiple USB devices, hence adding multiplexing overhead, besides the redundancy traffic would also appear on the USB bus, so I get around 8Gbps (practical USB3.1 limit) x 0.8 (4+1 RAID5 efficiency) x maybe 0.9 (USB multiplexing efficiency), so around 720MB/s. I just don't know how exactly multiplexing between 5 USB SATA controllers will slow down the bus, maybe the 0.9 figure is too optimistic, I don't know.
3. For a 5-bay (anything more than 4) hub-based enclosure (route 2 in previous comment), there has to be 2 1:4 hub controllers, one being downstream of the other. Will this kind of cascading negatively impact the performance? Since I will do uncached RAID, the access time is determined by the worst drive.
4. For future expansion, I might add new groups of drives. How does route 1 in section 2 compares with route 2 in terms of expandability? Say, I want to add another 5 drives without using zfs or unraid, if I went with route 1, I can't add drives to the fixed HW RAID, so the new storage will only increase capacity, not speed. If I went with route 2, the added drives, if on a separate USB controller, can speed things up, but can only do that if I rebuild the RAID, right? Meaning I have to backup everything and wipe everything, only then can I add the new drives, and I have to do this each time I add drives, and apparently it takes linearly longer each time.
5. Is it possible to have a partition be available both on NFS and SMB? I would like some to be shared to TVs and Windows/Android devices, which require SMB, and some to be shared to Linux workstations which require much lower latency, hence requiring NFS.

For those asking me to buy a full NAS, I hope I could afford one. Those with 10Gb connectivity and can actually use 10Gb are way above my budget. The R86S Pro is essentially free since I need it anyways for my 10Gb network, and the drives, well, I have cheap sources for them.

The original post: /r/datahoarder by /u/ecktt on 2024-07-04 13:11:47.

The original post: /r/datahoarder by /u/classicalist on 2024-07-04 12:29:56.

Hi,

Newshub New Zealand is closing tomorrow in around 19 hours from now (7pm NZ time or around 3am New York time on 5th July 2024). I am trying to archive Newshub.co.nz by entering some Newshub webpages into the Internet Archive. Just wondering if anyone is currently archiving Newshub as well? Apparently Newshub may create an archive on its own (https://www.newshub.co.nz/home/entertainment/2024/07/a-note-from-us-what-happens-when-newshub-s-newsroom-closes-this-friday.html) but after Paramount taking down multiple websites, I don't think big companies can be trusted. Any assistance would be appreciated. Thanks

The original post: /r/datahoarder by /u/Sebbzzzz on 2024-07-04 11:43:43.

Hi everyone.

I am making my first simple NAS and want to have some inputs on whether I should use a DAS like the Terramaster-D4 300 or a NAS like the DS224+ paired with a Beelink EQ13 Intel n100 minipc for transcoding. I have only purhased a WD Elements 12 TB that I will shuck the drive from and plan to use for media and might upgrade to 2 drives in the future. This setup is mostly for a single user of this plex, my wife might want to use it simultaneous some times.

What would you suggest? Using a NAS for media or a DAS through USB ?

The original post: /r/datahoarder by /u/JustAnotherPodcaster on 2024-07-04 11:34:50.

I have terabytes of data on a couple computers and I just want to copy and paste all that data from the computer to the hard drive and then from the hard drive to another hard drive so it's I'm too hard drives just in case.

I will organize the data over time which will probably take me around a couple months of accessing different folders and merging some of them or maybe even moving data from this hard drive to another hard drive were more of a certain category of that exists just to consolidate it all in the same place.

I have two options with my budget:

Seagate BarraCuda 8TB 256MB Cache 3.5" Internal Desktop HDD SATA 6Gb/s (ST8000DM004) (SMR DRIVE)

Normally $249.99 On Sale $184.99

WD Red Plus 10TB NAS Desktop Hard Disk Drive - SATA 6 Gb/s 256 MB Cache 3.5 Inch - WD101EFBX (CMR DRIVE)

Normally $329.99 On Sale $274.99

I read about SMR versus CMR drives and I don't know if it applies to me for my current needs. I'm going to insert these hard drives into a HDD enclosure (I decided to stop buying ready external hard drives because of some stuff I read)

At some point in the future I may buy one of those 4 Bay or 8 Bay HDD storage devices to keep things organized. I'm not sure how ready I am for NAS and purchasing these expensive devices to store my HDDs. There will be lots of reading and writing with these hard Drives that I will purchase.

Hopefully I explained it correctly to get proper responses. I'm buying it today.

The original post: /r/datahoarder by /u/puntoboy on 2024-07-04 08:53:07.

I don't know what to do about my Synology replacement. I have an DS1515+ that I use for media storage, OneDrive backup, and it runs some containers for things like Plex, *arr, etc. It's old and really really really slow. Backups take and age and I'm limited to the 4 x 1GB NICs it has (no expansion). I also cannot fit any more disks in so the only way to increase the storage is by changing the disks for larger ones, and the rebuild of SHR takes forever.

I now have two new rack mount hosts. I was going to use one as a direct replacement for the Synology but running Proxmox with some LXCs, Samba, etc. I've been testing this for a week or so but had some performance issues when copying data over via ZFS and it's maxing the CPU. This might just be a limitation of the CPU I have currently or the way I had the ZFS pool configured (temporarily using 4 x 4TB HDDs in RAIDZ1).

I hadn't really thought of a plan for the second host as I cobbled it together from parts I already owned.

Host 1 has the following:

• 20 x Intel Xeon CPU E5-2640 v4 @ 2.40GHz (1 Socket)
• SuperMicro X10SRW-F motherboard
• 64GB DDR3 EEC RAM
• 1 x LSI MegaRAID SAS3 3108 controller (JBOD Mode)
• 2 x Intel DC S4500 480GB SAS SSD
• 4 x 4TB SATA HDDs
• 1 x Intel X540-AT2 dual port 10GBe NIC

Host 2 has the following:

• 16 x AMD Ryzen 7 3800XT @ 3.7GHZ
• MSI B550-A Pro motherboard
• 32GB DDR4 3200 RAM
• 1 x LSI SAS9220-8i controller (IT Mode)
• 1 x Samsung 850 Evo 250GB M.2 SSD
• 1 x Intel DC S4500 480GB SSD
• 1 x 3TB SATA HDD
• 1 x Intel X520-DA1 10GBE NIC
• 1 x Nvidia NVS 300 GPU

I also have 3 x 16TB HDDs that I recently bought and the 5 x 14TB HDDs from the Synology. Happy to swap any of the hardware around as necessary. The cases are SuperMicro CSE-826 chassis with 12 x 3.5 bays and a SAS3 expander/backplane.

I currently have about 50TB of raw space on the Synology and I'm using 43TB currently (all backed up) to an Unraid server I have with mixed disks (4TB and 8TB).

Ideally I'd like to have a single host to replace the Synology with at least the same amount of storage I have today, I think I settled on configuring all of the big HDDs into a ZFS dataset mirror (2 vDevs) but maybe this isn't ideal. Of course I have some SSDs for any caching/logs if needed as well. Most of the data getting written to the host would likely be from VMs/CTs on the host but it's a NAS, so I do store some of my own data there as well. Maybe I can use the second host as my homelab for any extra VMs I have?

Without selling or replacing any of the hardware I have, what would you do?

The original post: /r/datahoarder by /u/xxjosephchristxx on 2024-07-03 12:21:53.

Hey all, I'm looking to use Next Cloud to share large-ish chunks of data (usu 256GB) with specific people. Maintaining the file structure of the data is critically important. The data would be backed up elsewhere, this is just to make it available to specific people in the short term. A friend of mine told me Next Could would be cripplingly slow at this but I'm hoping they're being dramatic. I don't mind it being relatively slow.

Thoughts?

Alternatives?

Right now I use Drop Box, but it's kinda spendy for how often I need this.

The original post: /r/datahoarder by /u/VerifiedSteveYzerman on 2024-07-04 01:45:48.

I have a 12tb Seagate external HD that has about 450gb of free space left. Im going to type out exactly what happened and see what you all think -

• I check my HD to see how many files are on there and it shows as 34,805 at about 12.3tb of space. They are sorted into 'watched' and 'unwatched' folders.
• reconfigure the files into 'list' so I can horizontally scroll them instead of vertical, they are still in separate folders.
• I disconnect the HD from my laptop the proper way (right clicking the icon, clicking 'disconnect' and verifying it says 'safe to remove' before unplugging)
• I plug in the same HD at work. It shows over 41,000 files at 14.3tb, the 'watched' folder is now copied into the 'not watched' folder, and it is no longer in list format but instead reverted to 'large icons'.
• I disconnect the HD properly again, reconnect it, and now its showing as slightly over 35,000 files, taking up 12.3tb of space, but the copied files are still present.

Thats it. Im sitting here now looking and can confirm the files are still present, and dragging a double into the other folder causes a message saying theres already identical files in the destination folder.

Any advice? Anyone deal with this before? Been using Seagate HDs now for over a decade and its a first for me.

The original post: /r/datahoarder by /u/theloquitur on 2024-07-04 01:32:42.

I have a set of SingleFile created zip.html (HTZ) files that were derived from sequential pages of an online book. I'd like to merge these pages together into a single archive so that they are organized and easily accessible to me. All came from the very same website's ebook. Are there any tools out there that could help me with this?

The original post: /r/datahoarder by /u/everlasting06 on 2024-07-03 22:32:32.

so i got a samsung 870 QVO that has 500 gb of storage and idk i formatted it for it to work but do i need to download something on it for to work well with my laptop or what ? cuz i tried moving some of my game to it but it refuses to do so and when i managed to move 1 game my ssd glitched i had to restart my laptop just to find the game files were damaged and i lost the game so any help pls ?

The original post: /r/datahoarder by /u/360jones on 2024-07-03 22:15:10.

Hi all,

I’ve got a Plex server running bare metal on windows plus a few other services, blue iris etc etc.

I’ve finally been able to get my machine wired in via Ethernet and now want to get unraid or a better nas OS up and running.

Is it possible to convert my bare metal windows image into an ISO > install unraid or Ubuntu and then install my iso on a virtual machine?

The original post: /r/datahoarder by /u/Payne-Not-Pain on 2024-07-03 21:58:46.

I am new to this and plan on buying a nas to run Plex and docker containers such as sonarr, radarr, sabnzbd etc. I want to know what nas I should buy to do this under $200. I also would like to know if I should just use a mini pc and a das instead and what recommendations yall have for that. Thanks

The original post: /r/datahoarder by /u/SomeNectarine7976 on 2024-07-03 21:55:17.

A couple months ago I shucked a 10 tb hard drive from an old office USB backup. This week I decided that with only 200 GB of steam games, I need to find something else to use this monstrosity for. I've started ripping my own copies of music and downloading. So far up to about 70 GB of just music. Might start working on operating system ISOs and then work into movies. Boy I hope my drive lives a long life. (Only had like 2 tb written when I shucked it)

The original post: /r/datahoarder by /u/GullibleDott on 2024-07-03 21:42:52.

Hello.

I've been looking for a way to save offline maps of certain areas. Anytime I search for something, just the "offline maps" thing from Google Maps shows up. I want to keep those maps on my PC and be able to use them offline. If the program supports showing GPX routes even better. That is important to me, as I keep my hiking routes in that format.

I looked everywhere for such a program, but I just cant find it. I figure people here might have some experience in that area.

Thank you!

The original post: /r/datahoarder by /u/LeGreatMaxiking on 2024-07-03 21:30:20.

I need to remove old series to get some more space, i have 85 TB as h265 content and im looking for a tool to show me which files werent never played at all and make a automatic script, would be good with a nice gui. Had something a few months ago, but dont remember the name and also it didnt worked out well.

Thanks

The original post: /r/datahoarder by /u/WaitForItTheMongols on 2024-07-03 19:49:32.

Here is the Amazon price history: https://camelcamelcamel.com/product/B084ZV4DXB

I picked up one of these, and figured I could get another whenever I needed, but I've been surprised to find that they've never gotten that cheap again. I didn't realize it was a one-time thing, especially since up until that point, the price seemed to be steadily declining.

Am I a fool to keep waiting? I'd really like to get more drives, but I'm a bit scared of refurbished drives with thousands and thousands of hours, and I also don't want to get server-grade drives that may be excessively noisy.

The original post: /r/datahoarder by /u/OnceUponCheeseDanish on 2024-07-03 19:12:21.

I went through and bulk changed a good chunk of my flac library's metadata.

Obviously, I've already multiple backups. Without directory/filename changes; I couldn't find a straight answer on whether or not 'Beyons Compare 4' takes these changes into account. Based on the logs, I don't think it does.

Any software alternatives I could use for this? Or should I just clear/replace the backups? (one at a time of course..)