Against. Your comment history is even easier to access and it's usually much more sensitive. If you really care about anonymity you need a stronger method.
Downvotes are not a slap in the face. They're the social equivalent of "hey, I disagree with your content or tone". Really it's not a big deal to me if they're public. I've downvoted by accident, or changed my mind before and upvoted later.
Now if you're talking about lemips, a list of user's ip addresses, that's a different story.
"Cryptocurrency is only a pyramid scheme and has no real utility!"