It does, but it generally takes a lot of downvotes to significantly change that. You also need a higher rep to affect others. We need these tools to deal with abusers, but anyone is free to use them as they like.