I know what you're talking about. I've been organizing a photography competition for six years now and sometimes I feel like doing it wrong :-).

When it comes to judging photos, I help myself by submitting photos for judging in the form of a poll to a wide audience.