Hey,
To preamble, I am complete noob when it comes to storage/NAS and don't know anything. Anything in here is stuff I gathered up from reading some posts.
My current storage setup is almost non existant. Most important things are simply "backed up" multiple times manually on each random drive I have on a couple of PCs, with some data on OneDrive and GDrive.
So long story short, I need a main NAS mainly for a redundancy QOL (better late than never):
- Single place where I can upload all my data, as currently it's heavily scattered and duplicated.
- I want the data to be synced to other endpoints automatically for backup:
- NAS in another location as additional backup, not used for anything else. Probably simple two bay 2x16TB - and probably RAID 1. Don't have one yet, will most likely setup once I get this one going.
- 16TB drive on my second PC, as another backup
- Locally encrypting files before cloud syncing. Only important files, so about ~1-2TB. Probably OneDrive, since I already have some space there and potentially one other in the future, like blackbaze. (heard about rclone, not sure if this is good or there are better alternatives).
- Two seperate external 8TB drives for important data and p4/git only, with manual syncing once a month or two, alterneting between the drives (just a failsafe in case of corrupted data being synced to other endpoints)
- Local Perforce / Git servers ~2TB (later on, I'll be making seperate server for that, so it's just for a year, maybe two).
- The Data:
- Most important files ~1-2TB (mostly personal photos/videos/docs). These files will be rarely accessed. Once I get them all sorted into a single location, I was thinking of burning them on BD-R disks.
- Other files to sync - ~3TB
- Random stuff that I don't care for loosing, few TBs, no syncing to other endpoints.
Files will be uploaded to the NAS manually (e.g. when dumping photos from my phone).
My main need is redundancy and potentially ensuring I don't sync corrupted files to other endpoints (so some kind of checksums when uploading stuff to the NAS and prevent syncing corrupted ones). Warning when corrupted files are detected would be great.
I don't need much speed in day to day operations (not sure if it's needed by the NAS itself in case of drive failure). Other than P4/Git, all data will be accessed very rarely (maybe a couple times a year).
My current idea was to get DS1522+ with either 8TB or 16TB drives and go with RAID 6, unless there better setups for redundency and my specific needs, as I don't know anything.
Drives, these are currently my main ideas, unless you can recommend better ones:
- 16TB WUH721816ALE6L4
- 8TB WD8003FFBX or 16TB WD161KFGX
So, my initial questions:
- Do you have any guidence for hardware (nas/drives), software (syncing/checksums), storage setup (raid 6 or something else?) and workflows on how should I go on about this setup?
- Do I go with synology or build myself? I can build PCs, but perosnally would like something that I have a less chance of screwing up.
- What to use for syncing into other endpoints and how can I ensure I am not syncing corrupted data?
- Do I need UPS for the NAS during normal operations (e.g. idling or simply copying) to prevent potential corruptions?
- How do I periodically check if all the files all alright (no corruptions or anything) from their initial state?
- Other tips?
Thanks!
