Ah yes, many of the ones I went to didn't have military history. Yet they made worship monuments just for the war in general. As a kind of obligation or something. I see RSL as just a place where people can go to gamble, so I don't even really associate it with military. It was much later that I learned that it's not just a gambling and drinking club, but something related to military which was a very weird mix to me.
ANZAC... yes... I dislike that a lot, but you can just avoid any event, unlike monuments everywhere.
Did your city not have any monument?
I thought it was the Turkish they mostly celebrate for killing? I met many people who don't really know anything about the history, but say something against the military, monuments and so on and they will get very angry with you. Then again, a few I met don't really care either way, maybe like you.
I just never met anyone who was against the war stuff. I saw some article on people wanting to change ANZAC day, but never met someone.