It's A Digital Disease!

The original post: /r/datahoarder by /u/skysurfer425 on 2024-10-07 18:23:38.

I’m still pretty new to the NAS world and trying to figure out the best backup process that fits my budget.  Long term goal is to get to 3-2-1 solution. In the meantime, I need something cost effective – even if less ideal.   I have some extra drives around, so my thought is to use a QNAP TR-004 DAS plugged into my NAS systems.  I’d use Hyperback and Goodsnyc to back up a Synology and WD NAS. 

My newbie question is if I have a JBOD or RAD0 on the DAS that is 72TB, how do I access it on my local PC because of Window’s file limits?  Am I right in thinking that it won’t be accessible since it’s greater than the 64 TB windows 10 limit? 

The original post: /r/datahoarder by /u/aygross on 2024-10-07 18:07:38.

Just a quick update it still works though you should do it all through NSSM.

https://pupontech.com/backup-network-storage-using-backblaze-personal/

The original post: /r/datahoarder by /u/Arszerol on 2024-10-07 16:40:50.

The original post: /r/datahoarder by /u/FrozenCyanide57 on 2024-10-07 16:38:26.

I have an HDD that contains around 1.5 million pictures most of them are large photos ~4MB each

Almost all my pictures are jpg

I'm looking for a photo management software to allow me to have a database and categorize them using tags etc...

I tried digikam but it is very slow, it doesn't even load all pictures from a directory. Even if that directory contains a couple thousand of pictures.

I tried with sqlite and MySQL too (installed locally).

My files are on an HDD connected through USB 3.0 Browing my files through windows is fine.

The original post: /r/datahoarder by /u/Busterpepe1 on 2024-10-07 14:43:59.

Hi I would like to burn some personal media onto a dvdr and have a copy of it on my ssd. How long do the Verbatim Azo last?

The original post: /r/datahoarder by /u/clump_of_atoms on 2024-10-07 14:17:09.

I don’t have any additional storage physically to download everything and reupload. Unfortunately, when trying to use rclone, I run into an API limit. Additionally, I am limited to slow speeds at home. I have access to a NAS at another location, with significantly faster speeds (but is also limited to several terabytes of free storage, and some of my files can be almost a terabyte). How would you recommend making this transfer as painless as possible?

The original post: /r/datahoarder by /u/JuanPepe417 on 2024-10-07 11:13:31.

Any way to bulk download slideshows like myfavett but for slideshows or a fast way to download slideshows? +2000 slideshows

The original post: /r/datahoarder by /u/Y2dgJulC9H on 2024-10-07 11:12:39.

I read some (roughly 50) books when I was a teenager, mostly religion and philosophy books in the good old paper format. I have taken lots of notes on the margin and made a lot of underlining and commenting. They are all at my moms back in my home country and I would like to archive them. I already host and archive documents and media which I access with one or two services with ease. What it would take to bring these books into the archive. Scan them probably, but how ? What service could be the best to store these?

My ultimate goal is to store and be able to index text. Regardless whether this is a website, article, blog posts or a PDF of a scanned old book.

The original post: /r/datahoarder by /u/silverninja888 on 2024-10-07 04:31:20.

I move around a lot and don’t have a fixed location, and HDDs are susceptible to breaking under the rough treatment of me dropping a backpack. So I decided to go with only external SSDs.

Anyway, I was wondering if I could partition one external 4TB SSD drive, with 50% being an encrypted backup of what’s on my computer, and the other 50% be an unencrypted heavily used portion for current projects I’m working on (I do video editing).

Of course I would occassionally backup everything on this SSD to another SSD.

Do you see any holes in that system, or would it in theory work as a mobile solution to secure encrypted backups with sensitive info in the case someone robbed me, plus using an unencrypted partition for projects (where the data isn’t sensitive)?

Are there any drawbacks regarding partitioning an SSD for use in this way?

The original post: /r/datahoarder by /u/maxigs0 on 2024-10-07 13:47:50.

Any recommendation what HDDs, possibly directly USB HDDs, to get for offline storage?

I want to do occasional backups, plugging it into the NAS, copying/adding the new data, and putting it on the shelf. It's almost always adding data, rarely changing anything.

The disks will run only for the backups and maybe (hopefully never) to get the data back in case of failure of the NAS.

Most data around live expectancy of HDDs seems to be about permanent usage, but i suppose such cold starts every few months are a completely different usage profile. Anything to be aware of here?

Or is there anything better these days? I'm looking to back up around 1 TB of new data per month, ideally somewhat cost effective and without too much work.

The original post: /r/datahoarder by /u/GrahminRadarin on 2024-10-07 13:18:45.

I'm running Windows 10, for context. I recently got a 131GB rar archive, and I want to extract the whole thing to my harddrive because the files aren't properly accessible otherwise. However, my harddrive only has 14GB of space left after getting this archive. Is there a way to use 7zip so that it extracts the files out of the rar archive and then deletes them immediately afterwards to make space for the rest of the extracted files? I want it to extract file 1, delete file 1 from the archive, extract file 2, delete file 2 from the archive, ect.

The original post: /r/datahoarder by /u/webcapcha on 2024-10-07 07:53:33.

I have key.dat files which is used for accessing government services.

How to properly securely store a backup? For my mind, it could be gpg encryption. What else approaches?

p.s. not sure if it's correct subreddit.

The original post: /r/datahoarder by /u/pukalo_ on 2024-10-07 07:30:46.

Hello, I was just wondering if the Verbatim Azo single layer DVD+-Rs are still considered a 1st tier brand for recordable DVDs, and if there are any specific brand and format recommendations for burning videos to DVD to watch on a DVD player? I know the difference between DVD-R and DVD+R, and I am willing to pay extra for high quality discs that will be most resistant to deterioration. Any specific recommendations between -R and +R, as well as burn speeds for burning videos for DVD player playback?

The original post: /r/datahoarder by /u/LinuxMaster9 on 2024-10-07 05:53:04.

I have a SuperMicro 6028U X10DRU-I+ 2U server and would LOVE to retrofit it to have modern CPU/Mobo like an Epyc 4004 series chip in there and maybe if possible lower the fan noise while I am at it. Is this possible? I would rather not chuck this 12-hotswap-bay server but it is rather loud and power hungry these days. Plus, it blows at transcoding even with Xeon 2690v4 chips in it.

The original post: /r/datahoarder by /u/FewExit7745 on 2024-10-07 04:24:42.

I don't know how common my situation is, but I have a Seagate 1TB External HDD from 2023 with >600GB of data in it, and I have to long format it. Before doing so, I transferred >400GB of my files to my 512GB laptop, and >200GB onto my 256GB Poco X5 Pro, using the Laptop as like a middleman.

So reformatting done. I returned the files from my laptop to the HDD and the transfer proceeded without problems. The problems occured when I moved the files from the phone to the laptop again, I did stagger the transfer into two batches, and for the first batch, the phone changed from "USB Transfer" to "Charge this device via USB" after all the files seemingly went through. The second batch was interrupted by "insufficient memory to execute..." stuff at about 60% of the transfer, thankfully the files were still on the phone, so I divided the second batch of transfer into two parts again, and the files finally proceeded to transfer this time.

Now my worry is if I have some data corruptions during this process, and if I have to check all these files if the play or show fine, [95% of them were videos(like >4000 of them) and photos(>1000), also 50GB of these files(from 2022) are my personal files, the rest are from the internet]. About 20 of these videos are nowhere to be found on the internet anymore. I did some random sampling on about 30 files in different folders and they were just fine.

All of the files are seemingly okay judging by their thumbnail but I have not time yet to check each one of them. I don't have the *checksums"(?) of the files before transfer

Please don't judge me for only having one drive, I live in a developing country with developing country wages. I am actually about to buy another HDD(or SSD if Seagate has good discounts on them) this December, a year after I bought the first one. Just so I can finally do "2-1" of the "3-2-1" here.

Finally, thanks for reaching this far, and sorry for my poor English.

TLDR: Would it bother you if about 5-15% of your files might be corrupted? Should I just delete everything (except personal files) and redownload them? Also around 5000 files and 600GB including personal ones.

The original post: /r/datahoarder by /u/jku2017 on 2024-10-07 03:37:16.

I cover events, often times i contract our photo and video if I need more resources. I'd like to simply drop an SD card into a storage device and it transfer all that data over.

If there's nothing like this, what can get me close to it without needing a laptop.

The original post: /r/datahoarder by /u/108er on 2024-10-07 03:14:55.

Today, I tried to access some old data from my hard drives that had been sitting in a cabinet for over five years, but none of them were detected. As soon as I plugged them into my computer’s USB ports, they just made loud clanking noises. One was a Western Digital drive, and the other was from Seagate. I had barely used them—essentially, all I did was store data on them, and now that I need them, they've failed.

I also tried accessing an old 700 MB CD using the CD drive from an old Optiplex, and surprisingly, I was still able to retrieve my old MP3 files and photos. These CDs are almost 20 years old! This made me think about saving data on CDs, but it’s not practical to store terabytes of data on hundreds of discs.

How are you all managing long-term data storage? I can’t believe how unreliable these external hard drives have become. One thing I've learned is that I'll never trust portable external drives for important data storage agai

The original post: /r/datahoarder by /u/anjowoq on 2024-10-07 02:02:10.

I was using the Internet Archive for the first time in a while this week and the search sent info on its losing court battle my way.

It looks like no one has posted on the topic in a few months. Do any of you have plans to try to preserve parts?

The original post: /r/datahoarder by /u/CadetDuck on 2024-10-07 01:53:59.

Hey everyone,

I’m trying to determine how much cooling my Dell GTP9G LSI 9217-8i card requires. It’s installed in a Fractal Design Define R5 case, and I’ve removed the side vent. Currently, I have an Arctic 120 mm fan pushing air into the case from the side vent on the case.

Do you think that setup is sufficient, or should I look into mounting a small fan on the heatsink? If I add the small fan to the card, would it be pushing air into the heatsink or pulling air out? I’ve seen people zip tie fans directly onto the card, but I’m unsure if that’s necessary since I already have the 120 mm fan blowing air onto it.

The original post: /r/datahoarder by /u/RenitOfTheStrongest on 2024-10-06 23:29:54.

The original post: /r/datahoarder by /u/cribbageSTARSHIP on 2024-10-06 22:13:34.

This post is a follow up to this post. I was trying to rsync my tv dir from one Truenas scale machine to another and the target dir wasn't growing in size. Turns out the source dir was reading as a larger size on the TN GUI because it was counting the zfs snapshots. User error to straight up user ignorance. lesson learned!

How does everyone here manage their zfs backups? I'll post my setup below, but I would love some advice as to how I can better manage my snapshots (or back ups overall). setting auto snapshots is fine but how many should I be keeping? how often should I be moving the snapshots off the machine onto a back machine?

Any thoughts would be great. I've just retired and want to develop better selfhosting/datahoarding habits now, so I have more time to enjoy things instead of retracing steps. These days I feel more comfortable trusting the CLI and making scripts than relying on a GUI. In my previous post I mentioned wondering if I should be moving away from Truenas because I was feeling constrained by it not being real debian. I'm on the fence between using Deb12 with cockpit vs TN Scale for both my NAS's, so if anyone else has pondered the same question, what are your thoughts?

Thank you

Machine 01: Deb12

raidz2 serving my ghost (plural) and nextcloud instances. Both of those are docker services.

Machine Legion: Deb12

a collection of machines with a 1TB nvme. These machines have various services on them and they wake on lan from an olivetun command, or other calls. when not in need they power down. The 1TB drive is formatted zfs, and everything installed on a machine has its relevant data on a child-dataset on its 1TB drive. Only two of these machines are on permanently for *legal* media sharing and other permanent services. There are seven overall.

NAS 01: TN Scale

5*10TB NAS HDD. Raidz1 with four drives+ hotspare. This machine will house all the media in child datasets. this is all served out to the legion via NFS shares (although a friend is suggesting sshfs). I'd like to be able to use docker-compose to spool something up if I need it. if anything, I have a torrent/vpn container that I'd like to have running here on a full time basis.

As well, my intent is to have the legion machines send zfs backups here.

NAS 02: TN Scale

16*4TB SAS drives Raidz3 +3 spares. This is the only machine that has spinning boot disks. Just have to put it all in the case, but this pig will be turning on once per week. It will take ZFS backups from NAS 01 and Machine 01. It will then run updates and shutdown.

The original post: /r/datahoarder by /u/iamwhoiwasnow on 2024-10-06 20:54:52.

I am running 2 8TB Seagate Barracudas and it has been over 100 degrees here all summer some days over 110. right now one of my drives started making a clicking sound, nothing too drastic. I went to touch the drives and they were both hot, not warm to the touch. I immediately shut down the server and drives but now I am worried that one of them might be shot. I will be replacing it soon hopefully but I was curious if these temps kill a drive?

Edit: I let the drives cool off and restarted the drive and I am running the drives and there is no more noise

The original post: /r/datahoarder by /u/czah7 on 2024-10-06 20:41:33.

https://serverpartdeals.com

Anywhere else that is trusted? I'd rather not buy from a random guy on ebay. Maybe a trusted company that is reselling used.

I plan to use this only for PLEX. I have a 4bay Synlogy that I hope to stick from 16-20tb drives in to replace my smaller ones.

Couple questions though.

Is there any difference in 7200 HDDs? I normally buy WD Reds. Is it safe to get any brand? Anything I should definitely AVOID?

What's a good price? I.E. $10 per TB?

Is there any good tools to find price history on drives?

The original post: /r/datahoarder by /u/taxig on 2024-10-06 20:39:37.

Hi, I have a trascend storejet 35t3 that is disconnecting from my Mac very often, and the only way to have it back is to disconnect and reconnect the usb cable. I suspect that the enclosure is broken, and would like to remove the HD and try to connect it to a usb to data adapter. I cannot find any guide on how to open the case, tho. Do you have any tutorial/advice/link to help me? Thank you in advance.

The original post: /r/datahoarder by /u/Glittering-Skirt-816 on 2024-10-06 20:06:34.

Hello,

Working in the field I have a few ideas but I wanted to know if you knew why no NAS solution is proposed with an ARM/RiscV architecture knowing that for NAS the power consumption is more important than for PCs.

Thank you for your help,