I think downvotes should be accompanied by a comment explaining why the post was downvoted. That way users can learn why they were downvoted and decide whether to modify that behaviour.