As I've said many times, for the most part my downvotes are an opinion that the rewards are too high. It is completely subjective. The system tallies the votes and pays rewards after 7 days.

Of course, I will also on occasion make votes for other reasons, but that's 90% of it at least.