It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
6951
 
 
The original post: /r/datahoarder by /u/Big-Share1509 on 2024-08-31 02:21:17.

Curious to hear from people who use a micropc as their plex server with a DAS/ JBOD over usb. What has your experience been like ? Has it been problem free ? Especially interested in people who use plex to its full capabilities, as in regularly having people connected to their server, using high bitrate 4k remuxes, using hardware based transcoding with tone mapping etc. Are their any “gotchas” to this kinda of setup ? I really am attracted to the thought of running a power efficient setup like this.

My first attempt at running a setup like this did not go well and I am trying to explore all options. I've settled on running plex on either a micro pc /nuc with usb 3.0 DAS OR an regular pc with ATX case and a ton of 3.5 hard drive bays. Seem to be compromises either way. The DAS over usb 3.0 I've heard can have connectivity experiences, which I also encountered on my first attempt. The ATX case with a ton of JBODs is power hungry, and there aren't readily available 35W processors out there. 65w seems to be available on newer intel 12th gen+ cpus. Thoughts?

6952
 
 
The original post: /r/datahoarder by /u/The_Flo0r_is_Lava on 2024-08-31 00:57:39.

I currently have a 12 bay synology I bought about eight or so years ago that has 12 10tb drives in it as raid 5e.

In the future I want to get another 12 bay synology and begin filling it with 20 tb drives.

I am aware that the more drives the faster the read speeds. I'm looking for the upside and downside of the upgrade.

I mostly download and serve movies and TV shows.

Would I be better off building it as 2 split arrays and lose the extra space to the raid parity twice, or one mare array over 200 tb?

Thank you!

6953
 
 
The original post: /r/datahoarder by /u/Mallengar on 2024-08-31 00:42:57.

First time posting on this subreddit, and I'm not sure if this is the right place, but I saw a similar post in search. My preferred video downloader was the above mentioned one in the title. A few months ago, it stopped working for me, and it seems like re-downloading and reinstalling it isn't helping. I don't see any updates past the 9.0beta. I fear the worst, and the program/programmer got... cracked down upon? Not sure if that is the right phrasing. Does anyone know what happened? If it's gone for good or maybe they're planning a return?

6954
 
 
The original post: /r/datahoarder by /u/Reynarok on 2024-08-31 00:19:56.
6955
 
 
The original post: /r/datahoarder by /u/nmn_guy on 2024-08-30 22:16:20.
6956
 
 
The original post: /r/datahoarder by /u/Lets_Go_2_Smokes on 2024-08-30 22:12:22.

I've been using Roxio VHS to DVD with VirtualDub, and while the VirtualDub file sizes are large (about 1GB per minute), the quality is significantly better than the Roxio software. However, I'm having an issue where the recording randomly shows a blue screen, as if the tape has ended. If I stop and start playback, the video shows up fine again.

I know VHS technology is quite different and unfamiliar to me. It seems that when the tape hits a problematic area (like grainy video), the recording stops and doesn’t resume. After some research, I think this might be related to Time Base Correction (TBC). When I connect the VCR to a TV, the video plays without issues, but with the Roxio hardware, the recording stops randomly.

Could this be because of the cheaper Roxio hardware? I've seen options like analog-to-digital converters, upscalers, and capture cards. I'm not looking to spend a fortune but was quoted $700 to have my tapes converted professionally. I'm open to buying decent hardware to get the job done myself. Any advice?I have seen options line with analog to digital converted with upscalers and capture cards.

Finding out where the recording stops and starting again is becoming annoying. Id like to just have a tape play from beginning to end and have it recorded.

6957
 
 
The original post: /r/datahoarder by /u/BigMickDo on 2024-08-30 21:25:30.

Hey, I have large amount of json and html pages (close to a million) I've scrapped that I don't feel like processing now, but it is starting to be a problem given how many I have in raw format and it is inefficient.

I'm looking for ideas, things I've considered:

  1. I can store few meta data that I need (like page ID) and just zip the files till I decide to parse them.
  2. appending to parquet monthly to compact them.
  3. throw them in a DB with important meta data modeled but store the raw json/html as text so it can be compressed, but I'd like a db that's storage efficient and doesn't corrupt easily.

Can do something like sqlite archive, duckdb or postgres (for toast) maybe for third option.

6958
 
 
The original post: /r/datahoarder by /u/Hungry_Swordfish_798 on 2024-08-30 21:00:12.

I'm already a member of multiple PTT's and wish to download&seed more, my question is not of budget but more accessibility, as ive always been a hoarder. Im looking for the best setup for downloading and seeding rare films

6959
 
 
The original post: /r/datahoarder by /u/Spyke2269 on 2024-08-30 19:55:24.

So I'm a Swing Tech for a traveling production. My job is to know what the other everyone else's job is during the show so should anyone get sick, the show goes on. This means I have about 7 different paper tracks to reference. I'd like to combine all them into a document outlined by scene with drop downs for every department within that scene. Ex: The props guy get's sick and I have to swing in, we're in the second song of the second act so I would open my tablet, go to this document, click that particular song which would give me a sub directory of all the departments, then I would hit props, and it would take me to the props section of that song.

So far I've tried a few personal wiki sites and Obsidian and none of them have worked for me. All of the wiki things I've tried have been faaaaaar too complicated for me to understand for the application I need it for and Obsidian isn't exactly what I'm looking for.

Does anyone have any other suggestions?

6960
 
 
The original post: /r/datahoarder by /u/analog_kidd on 2024-08-30 19:51:50.

I'm in the market for my first NAS. I had my eye on the Synology DiskStation DS423+ and was about to go ahead and buy it, when I noticed the TerraMaster F4-424. Both are the same price, but the TerraMaster seems like a much better device, hardware wise. It has a newer / faster CPU and more memory.

My use case is mostly to store media for Plex, which will run on it's own server for now. I may one day decide to move Plex over to the NAS, so I want to make sure I have the most bang for my buck with hardware. I'll also be running some Docker containers, such as file and photo hosting, dashboard, etc.

The Synology seems like the 2gb memory is not enough, so I'd likely expand that right away, which brings my cost up. The TerraMaster with 8gb out of the box would not require that upgrade, so I'd be saving money.

I've hear the TOS is not that great, so I suppose I could install UnRaid, but then I'm back up to the same cost as the Synology+RAM. How bad is TOS? Is it something I can live with? How much better is UnRaid? I'll want to start off with a pair of 18tb drives, copy my media over, and then add the 18tb drive that is in my plex server over when the dust settles. At some point, I'll buy a 4th 18tb to finish it all up. So, I'll need to be able to expand the pool along the way. I think either O/S will do this.

Anyway, I'm just not sure which one I'd be more happier with. I can't go wrong with the Synology, it's got everything I need. the TerraMaster seems like a better value, but at what sacrifice?

6961
 
 
The original post: /r/datahoarder by /u/QuantumFreezer on 2024-08-30 19:29:14.

I have a Synology Nas with an unencrypted 80tb volume. I also have some spare drives. I'd like to build a power efficient nas out of the drives I have plus some new, move data across and build the volume from scratch. I like n100 because od how efficient it is but looking at cwwk mobo it can only handle 6 drives while I'd need at least 8 to get enough space and that is with no extras I think (would need to have another look at what drives I have available).

Would you have any suggestion for something that fits the bill?

After moving the data over I'd likely keep this built on top of the Synology or might sell syno and build another custom one as I'm growing tired of it but energy efficiency is a priority for me.

Do I need n100 for transcoding? No I have another pc for that but just like the idea of the n100. An alternative is putting something more powerful in to replace the i7-6700 or whatever it is I have running frigate at the moment but it has it's own powerful DC ups so that would open another can of worms.

6962
 
 
The original post: /r/datahoarder by /u/InfaSyn on 2024-08-30 18:07:55.

Original Title: AnandTech is shutting down! - Anything we can do to archive the site? Tonnes of great material for vintage hardware which is difficult to find anywhere else. In a position to help, but unsure where to start

6963
 
 
The original post: /r/datahoarder by /u/Brick_Rubin on 2024-08-30 17:44:52.

Hey guys, so Im currently running an 8TB NAS on a netgear ReadyNAS Ultra 6. Recently I've been running into some trouble where during bootup the nas will start up, spin up disks, then shut down and try to boot up again, it'll do this about 6 times before fully booting.

after that using the NAS and accessing files isnt really a problem BUT sometimes when I try to copy larger files off the NAS to a local drive the NAS will shutdown and reboot and then after that I can copy files fine.

Im thinking maybe the PSU is failing so I am scouring around for a compatible PSU but w=could you guys tell me if maybe its not the PSU and maybe I should be looking else where to diagnose it?

Please let me know if this isnt the right spot to post, obviously im scared of losing all my data and I figured you guys can understand my fear if anyone. :) Thanks!

6964
 
 
The original post: /r/datahoarder by /u/fortune82 on 2024-08-30 17:21:01.

Essentially, I'm trying to find a copy of Give 'em the Pickle! but as the book was released in the late 90s, I don't think an ebook was ever made for it.

I was hoping I could purchase a hard copy, and send it off to someone to properly digitize it. I wasn't sure if there were reputable services to do so, and I'm not about to invest in a digitizing station for a single book.

6965
 
 
The original post: /r/datahoarder by /u/ThisIsntRealWakeUp on 2024-08-30 16:35:14.

Hey y'all -- I'm not a data hoarder (yet) but I have about a TB of extra disk space that I don't plan on using and a fast internet connection. I'm hoping I can put this to good use by seeding a torrent for something that could use more seeders.

Preferably something of scientific utility (like, idk, astronomical survey data) or tech related like LLM datasets or Linux ISOs or IT tools, just as some examples.

Doesn't have to be a legal torrent. I have a reliable VPN that I can pipe my torrent traffic through.

6966
 
 
The original post: /r/datahoarder by /u/QuickNick123 on 2024-08-30 16:34:31.

Just need to get some excitement off my chest:

tl;dr My raidz2 lost 3 devices and continued working (mostly).

For the last week or so my LSI HBA has been suffering from the current heatwave, which results in it "losing" some drives every now and then. They go offline and come back online a second later. I have 16x 16TB HDDs in a zpool consisting of two raidz2 vdevs with 8 drives each.

Today, for the first time ever, one of my vdevs had three devices missing at the same time. I would have expected this to result in something catastrophic, make the pool inaccessible or maybe even corrupt it entirely.

But instead zpool status just told me that the pool is degraded, some files are inaccessible and I should use zpool status -v to get more details. That returned a list of files that can't be accessed at the moment.

I was still able to read and write the pool. Even files that I knew must be located on the degraded vdev (since they were old and ZFS doesn't rebalance when adding new vdevs). I'm guessing writing worked because I had a second vdev that wasn't affected?

After I cleared the pool it got resilvered and everything was back to "No known data errors".

How great is this behavior? I was fully prepared to restore the entire pool from backup, but was pleasantly surprised how hard ZFS is working to keep your files accessible, even when a vdev becomes degraded beyond the point of available redundancy.

6967
 
 
The original post: /r/datahoarder by /u/Hamilton950B on 2024-08-30 15:51:22.
6968
 
 
The original post: /r/datahoarder by /u/ajdisab on 2024-08-30 15:21:58.

Best Storage for my Use Case?

Hi there. Fairly a noob in this space. My goal is to have storage that I can update / access from my home PC as well as have a secondary mini–PC access for Jellyfin. Is a NAS necessary for this? Or can I simply switch a large HDD or DAS between PC's when I'm not using it for Jellyfin?

Thanks!

6969
 
 
The original post: /r/datahoarder by /u/cleanSlatex001 on 2024-08-30 14:41:31.

https://www.anandtech.com/show/21542/end-of-the-road-an-anandtech-farewell

Any thoughts folks ?

6970
 
 
The original post: /r/datahoarder by /u/giratina143 on 2024-08-30 13:35:06.

https://www.anandtech.com/show/21542/end-of-the-road-an-anandtech-farewell

It is with great sadness that I find myself penning the hardest news post I’ve ever needed to write here at AnandTech. After over 27 years of covering the wide – and wild – word of computing hardware, today is AnandTech’s final day of publication.

o7

The farewell also claims their corporate owner will “indefinitely” keep the site up, but we all know what corporate promises are worth.

Time to pull out the archivinator - 3000 folks.

This time we will have plenty of time to archive it, hopefully.

6971
 
 
The original post: /r/datahoarder by /u/lucifierS on 2024-08-30 10:40:05.

I recently bought a new phone and when i transferred the photos and videos some of them (specifically the one's from WhatsApp media) lost their exif data , i used a tool to edit the data from thier name but it edited it into the modified dae not the taken on date and my gallery still show the taken on dates. So i need a tool (preferably android) to edit all the taken on dates to be same as modified on dates

6972
 
 
The original post: /r/datahoarder by /u/SeparateFly on 2024-08-30 10:20:14.

I recently found a 1 TB thumb drive online for $17 and wanted to test it out. I ran f3write on it and it was clear the thumb drive held nowhere near 1 TB. The following are photos and I am wondering what is ACTUALLY in the drive? Much thanks

https://preview.redd.it/day5bxax1sld1.jpg?width=4032&format=pjpg&auto=webp&s=a2bcac2ecac3a24facd99f97946e016049b832ad

https://preview.redd.it/ttrq9xax1sld1.jpg?width=4032&format=pjpg&auto=webp&s=2fe7b0c7324a3fc56bc5e9e3b0c21f8f7b321a6f

6973
 
 
The original post: /r/datahoarder by /u/Minute-Angel on 2024-08-30 09:15:55.

Looking for something for indoors that is minimal work to set up (e.g., cabling, power) and can only be accessed on the internal lan + full end to end encryption, what are you guys using?

Having a microphone and speaker built in too for each camera would be great for 2-way communication

6974
 
 
The original post: /r/datahoarder by /u/Bluedroid on 2024-08-30 08:53:47.

Hi guys, I'm looking at a good external SSD for backup which can sit there for years. Will need probably a 2tb or possibly 4. Copy speeds aren't too important I'll probably back up extra stuff every month. Important thing is that it'll be sitting there for years. I've previously had multiple 2.5 spinning externals from Seagate and wd fail after 5 years. I'm looking at either a Samsung t9 or possibly getting an internal nvme or 2.5ssd and enclosure.

Thanks

6975
 
 
The original post: /r/datahoarder by /u/naivehandler on 2024-08-30 08:08:48.

first me. To me it was a time when i had to leave home for studies with only a dumb phone(aka feature phone no internet only radio) after 2 years i came back to my native place and had a download of an anime then there was a relief in my heart spiritually something weighing on my heart was relieved. whats yours?

view more: ‹ prev next ›