If you have to agree to it to buy something as basic as a home then it isn't truly consensual. Hell, it isn't even truly consensual for less necessary stuff like cars (you "agree" to surveillance - arguably a necessity in less developed places), digital goods (same - also more or less necessity), games (you agree to not own dogshit) and other things. Hell, you keep "agreeing" to workplace rules supposedly "freely", but we all know it isn't.
There are certain basic rules everyone has to agree to (laws) to uphold society, but other than that any agreement like HOAs have to be truly optional if your argument is supposed to work. And no, just "going elsewhere" isn't a fucking option in the current disastruous market. Especially since that nonsense appears to be so common in the US.
HOAs are indeed common in the "land of the free".