check to see which accounts are downvoting you and then check to see which witnesses they support

check to see which accounts are downvoting your friends and then check to see which witnesses they support

ALSO,

check the delegations

for example, i received a large downvote from @usainvote and it's not obvious who controls that account, but if you look at the delegations...

and then it just makes sense to check...