It's A Digital Disease!

The original post: /r/datahoarder by /u/saltyspicehead on 2024-06-13 16:53:05.

6 x 12TB Drives, Raidz2, NVMe L2ARC + SLOG etc etc etc roughly 45 TB to work with.

I'd like to start by creating a weekly Wikipedia backup job to track change history. I'm familiar enough about storage tech to know that this should be possible without consuming a new ~120GB of storage every week, since only the delta will actually consume any disk space. However, I'm not familiar enough with non-enterprise solutions for this task. I see a few tools in the wiki but I'm not sure which one is best suited for this situation.

Any solutions or guides you can recommend? I'd prefer not to enable dedup on my primary pool, but if that's the best option then I'll likely just create a secondary pool for this specific task.