The rewards just get distributed to other posts. It doesn't go to larger stakes or smaller stakes. Your stake doesn't have much to do with the author rewards on your posts unless you're a huge stakeholder voting your own posts.