Selfhosted
A place to share alternatives to popular online services that can be self-hosted without giving up privacy or locking you into a service you don't control.
Rules:
-
Be civil: we're here to support and learn from one another. Insults won't be tolerated. Flame wars are frowned upon.
-
No spam posting.
-
Posts have to be centered around self-hosting. There are other communities for discussing hardware or home computing. If it's not obvious why your post topic revolves around selfhosting, please include details to make it clear.
-
Don't duplicate the full text of your blog or github here. Just post the link for folks to click.
-
Submission headline should match the article title (don’t cherry-pick information from the title to fit your agenda).
-
No trolling.
Resources:
- selfh.st Newsletter and index of selfhosted software and apps
- awesome-selfhosted software
- awesome-sysadmin resources
- Self-Hosted Podcast from Jupiter Broadcasting
Any issues on the community? Report it using the report flag.
Questions? DM the mods!
view the rest of the comments
I don't know what ARC is and my searches so far haven't helped. The CPU usage is pretty low, on htop is rarely passes 10%.
Edit: I asked chatGPT what it means, this seems like exactly the setting I was hoping to find. I'll check it out and post an update.
Edit2: I changed the ARC size to 8GB and it definitely seems to have gotten slower.
this is the limits of a slow interface and 5 drives. See my other reply to enable faster pci speeds. because of how zfs works 5 drives is slower than 3, takes more cache and write speeds especially will be slower, quite a lot slower. with 5 drives and 16gb you can easily have a zfs cache of 12 gigs to help it along, i guess this is why you are getting large gaps between writes. as someone else said a pi doesn't do well in this case but I reckon you can improve it. however as also said it is never going to be a speedy solution. secure and safe for data but not fast
Do you have the 8GB version of the Pi 5? You shouldn't set the ARC to 8GB then. Usually it about half of the available system RAM. I'd probably set it lower if there's only 8GB available in total.
16GB of RAM. I figured it might be overkill but I went all-in anyways.
ARC is the in-memory cache used by ZFS. If it's completely off the effect can be dramatic. Under no circumstances should a larger cache cause anything to get slower, ever. Even the raspi didn't have memory that is that slow that this is a reasonable outcome. By default on most distros, ARC size is capped to 50% of physical system memory. Keep in mind it is a cache: if something else needs needs the RAM, it will be released.
As a concrete example: I was recently working on a server where a maintenance task that should take like 12hrs or so at the worst somehow took 2 weeks (!) and still wasn't finished. That was ARC being disabled.