It's A Digital Disease!

The original post: /r/datahoarder by /u/coffeesleepi on 2024-07-30 09:09:26.

I want to know if there is any open source software I can use to organise and manage photos and videos similar to what Google Photos does, if I search dog it shows dog photos and it suggests those look back albums like 5 years ago.. etc. I know that to add the tags for the search it will need integration with an AI service and that is fine to be a paid integration.

The original post: /r/datahoarder by /u/Hungry_Tea_1101 on 2024-07-30 08:07:50.

I'm looking for an excel like but can handle billions to trillions of data records and is not getting slower to open when i continuously add millions of data to it, to put it simply is there an excel alternative that has no limit and is unlimited and not slow (works locally,offline use in external hdd) ?

The original post: /r/datahoarder by /u/flowerforestfarms on 2024-07-30 05:35:43.

LibGen being down at the time of me browsing this sub for the first time is definitely pushing me to get my backup of the entire LibGen and ZLibrary catalogues. Can anyone help me find the easiest way to go about this task? Thanks in advance for your time.

The original post: /r/datahoarder by /u/tr4jon on 2024-07-30 18:20:21.

The original post: /r/datahoarder by /u/Random-Account-343 on 2024-07-30 18:10:15.

I'm trying to archive the posts of a certain user I like, but I can't find any twitter downloaders that save the text content of a post

The original post: /r/datahoarder by /u/YourWormGuy on 2024-07-30 15:12:47.

Hello all. I'm hoping I can draw upon the expertise of the people here.

I have a server rack setup that I used to host my Plex server. All of my equipment is rackmounted and I'd like to keep it that way. I am technical enough, but I'm not highly technical.

My current setup includes two Netgear ReadyNAS units that each hold 4 drives. I am running RAID 5 on those NAS units. I'm not hosting the server on the NAS units, only the data. I'm hosting the server on an Mac Mini M2 Pro that I purchased less than a year ago.

Purchasing larger drives for my existing NAS units will only really increase my storage incrementally, and I'd like the ability to add a good amount more storage moving forward. So I'm trying to figure out my next steps regarding upgrading my setup. I would be willing to forego a RAID configuration for for the new setup, and possibly go with a JBOD setup if it was cheaper and would work.

I'm really not interested in ditching the Mac based setup I have now. I understand that more power could be had for cheaper using PC based setup, but I already have the setup that I have, and everything in my home is Mac based and it all plays nicely with each other.

I'm hoping the folks here can point me in the direction of what kind of hardware would be best to add more storage space going forward. I have seen so many different recommendations on which direction to go. But most of those are either for a PC or Unraid based system (If Unraid would play nicely with my Mac setup, I wouldn't be opposed to that going that direction with my upgrade, I just don't know if it would).

Cost is somewhat of a concern. If I had a ton of money to burn, I'd probably just pick up a large Synology rackmount NAS for $6,000 and call it good. But I don't have the money to spend on a setup like that right now. Ideally, I'd like to be able to add hard drives as needed rather than all at once (like I did when I had to buy 8 hard drives at once for my existing setup).

If anybody here could point me toward the type of hardware I should be purchasing to accomplish what I am looking to do, I would greatly appreciate it.

The original post: /r/datahoarder by /u/50mmprophet on 2024-07-30 13:50:13.

Hello. I need a solution for saving up my photos and videos (I'm a hobby photographer / videographer).

I will not backup all the time, but regularly dump my working external SSD on the HDD, so let's say two-three times / year/

I was thinking to get a 10TB 3.5'' USB3.0 Western Digital Elements External but I've read not the best things about it around here.

My other thought then was to buy an external HDD enclosure like this https://www.startech.com/en-eu/hdd/sdock2u33 or LC-POWER or ICY and a BARRACUDA ST8000DM004 in it, I really like the flexibility of it, but I've read all kind of potential issues with the docking stations. I'm also using a MacBook so another aspect is that I've read they can perform really slow on them.

I don't want a huge financial hit to start with, I prefer to add more space after. I need this to be somewhat simple, connect MacBook, save everything, put the HDD in the closet until next time, so no need for NAS or anything to be on 24/7. I really know things should be backed up in more than one place, and I will add that eventually (if I go on external route I will buy a second one in the future or another barracuda).

What are your thoughts and what are my options? Especially experiences with docking stations and enclosure.

The original post: /r/datahoarder by /u/Not-The-Dark-Lord-7 on 2024-07-30 09:52:36.

Hi, I am having a difficult time figuring out how to approach building a media server. As much as this sub preaches backing up, I assumed that having at least one backup would be a no-brainer. However, I’ve seen the idea floated that media servers filled with content downloaded from the internet shouldn’t be backed up, as it’s not worth it, and if/when you suffer data loss, you just make sure to have kept a manifesto of what you have downloaded and go back to redownload everything. This could be made easier with something like Radarr and Sonarr. But still, I feel like once I’ve downloaded something, why wouldn’t I safeguard it? So the three ways forward I see are as follows:

Use a cloud backup provider like Backblaze. The biggest con is that redownloading all the data would be slow, and take a long time.

Use RAID 1. I’m not sure I’d actually want to use RAID, I might just literally copy every download to both drives, because RAID seems not user friendly and also once you do it you’re kinda locked in place. But either way, people say that RAID isn’t actually a backup, and more of a way to prevent downtime. Which I don’t care about (that much) for like a personal media server.

No backups. When I lose data, just try to redownload everything.

I’m sure people here have massive media servers, so I’m interested in seeing if/how you guys back them up. Thank you in advance for your useful input!

The original post: /r/datahoarder by /u/MrCatberry on 2024-07-30 09:49:44.

Hi guys!

Need some of you datahoarder hive opinion

Following situation:

Currently got a HP D3600 with 12x 10TB SATA drives lying around, but its too loud for my taste.

Current TrueNAS server is a "little frankenstein", Intel 4th Gen,2x 256gb SSDs, 2x 14TB, 1x 10TB, 3x 6TB - no redundancies, has grown over time, got a little bit out of hand, now i want to change for the better.

My new build prefered case would be the Fractal Design Define 7 XL in Storage config, so plenty of space.

But... should i use the 10TB drives out of the D3600 or would you rather flip it and buy like 18-20TB drives?

Sadly i cant really use serverpartdeals.com as im EU based and Import Tax and Duties would kill the great deals.

Interested in you opinions.

The original post: /r/datahoarder by /u/gwrecker89 on 2024-07-30 08:09:22.

For anyone who's accounts have bren disabled, is it temporary or permanent? And if it's temporary, how ling does it last?

The original post: /r/datahoarder by /u/CriticalAd3682 on 2024-07-30 07:47:00.

Thing is, Our whole country internet was blocked completely for 6 whole days. I never suffocated more in my life.

The original post: /r/datahoarder by /u/zatakazz on 2024-07-30 06:57:08.

The original post: /r/datahoarder by /u/ChillCaptain on 2024-07-30 06:20:37.

I’m archiving a bunch of games and have been downloading and unzipping files at the same time. A lot of my files are fragmented.

But I’m not too concerned with performance since this is backup copies.

But now I’m thinking that maybe the files will last longer (errors or bit rot?) if I defrag them.

Any science or bro science to back up (pun) your opinions?

The only thought I have is that if the drive is on the verge of failing, having the files defragged might help when trying to recover the data.

The original post: /r/datahoarder by /u/Leonel_Busto on 2024-07-30 05:39:24.

hello everyone! I have been on the wayback machine and downloaded two files, one is .asx and the other is .ram. The website is supposed to be from 2002 and I have tried to reproduce them but it is not possible, any help?

The original post: /r/datahoarder by /u/Marble_Wraith on 2024-07-30 02:19:11.

The original post: /r/datahoarder by /u/bitpandajon on 2024-07-30 00:41:41.

Since I’m putting data safety above performance I guess I’m going with a raid 6 configuration. Anyone have a good idea of hardware I can use or videos to start my journey? Thanks

The original post: /r/datahoarder by /u/ZOODUDE100 on 2024-07-30 00:14:54.

My usual downloaders aren't working.

I would appreciate any help!

catch.tube, tube ninja, keepvid, clipconverter

https://www.pbs.org/video/hitlers-olympics-dBYL0N/

The original post: /r/datahoarder by /u/kuhas on 2024-07-29 23:53:13.

As title says, I'm looking to download a video. My standard Firefox plugins aren't doing the trick.

Has anyone tried and had success?

And example is here: https://stream.nbcolympics.com/beach-volleyball-pool-play-match-20?olypid=12000257&olyfer=true

The original post: /r/datahoarder by /u/AlexFireFox on 2024-07-29 23:35:08.

There are two HDDs I am currently looking at and can't decide which is better. The first is the WD Elements 2TB HDD and the second is the Seagate One Touch 2TB with password. I was recommended the Seagate one by a user of this subreddit and the other I found myself. The WD has more reviews and they are more positive.

The original post: /r/datahoarder by /u/taintedplay on 2024-07-29 21:49:48.

I have a few portable hard drives that I back up files to. So far, I’ve been just creating a new folder on the backup drives with a date and copying all files into that folder (in their own folder system). I keep the backup drives in a fire safe between backups.

Is there any software I should be using that’s more robust? Or is a simple copy/paste fine.

The original post: /r/datahoarder by /u/AJUniverse on 2024-07-29 21:26:43.

Hi, I'm looking to consolidate all my media (mainly raw videos and photos) and also have it accessible to around 3-5 users for video editing purposes. I currently have 645TB of media and would like to have 1000TB of total storage or more.

Currently have a "TS-h2477XU-RP" but only getting 1mbps download speed sometimes.

Don't care the price or if it's usually for businesses. Looking for large storage, and good speeds (especially via network connections).

The original post: /r/datahoarder by /u/RockyBoy502 on 2024-07-29 21:22:58.

Hello, I just built my first PC. I’ve been using a Mac Mini + 4 disk external to support my Plex library for quite a while now. I have no redundancies in place. Making a 1:1 backup just isn’t in the budget, as I will now have 120 TB to work with. I currently have filled 50.8 TB. I plan on using it for gaming, as well, so I decided against Unraid, as it doesn’t seem to function as well. In the future I may end up having 2 PC’s as I should’ve done. My question is what would be the best solution to add redundancy? I’ve read it’s almost a guaranteed fail using Raid 5 or 6. Any help is greatly appreciated!

The original post: /r/datahoarder by /u/KawaiiWaterbottle on 2024-07-29 21:05:22.

I wanted to get an external hard drive because the storage on my laptop is slowly nearing it's limit. But then I read that they only last up to 5 year? How am I supposed to save anything?

The original post: /r/datahoarder by /u/Kltpzyxmm on 2024-07-29 19:17:45.

I am looking to manage my power a little better but try to maintain my lab needs as best I can. I am curious if it would make sense to move by backup ZFS array to the second node and just power it on say weekly, run snapshots and shut it down. This will save some significant energy, I estimate about 150-200 watts of runtime but just not sure how good of an idea it would be. Any other options?

The original post: /r/datahoarder by /u/mr_white79 on 2024-07-29 14:45:57.

Besides the Samsung MZILT30THALA 30.72tb SSD, are there any other SAS 2.5" drives on the market with that type of capacity?

I can't actually find any retailers that have more than one or two of the Samsungs in stock or find any with the ability to get more.