The last time I brought this up, I was told everything from "you're just being paranoid" to "the system was re-adjusting to the latest drop in the SP at the exact instant you voted."
Anyone else noticed this phenomenon, or does it only happen to conservatives/Christians/patriots like myself, with their own personal, assigned, serial downvoter (like 
TIA...for any feedback/info.