On VYB there's no need to decline rewards, remember? Downvotes won't affect earnings. Downvotes can affect POB earnings but VYB is working out a way to upvote POB posts to return earnings from downvotes.

The only thing you have to decide on is whether you don't mind your reputation being reduced by downvotes from hive accounts.