For the reason's you've given, the downvote button can be considered a "STFU button" when used improperly, instead of being used as a moderation button.