There is a mechanism that lowers (decays) your voting power against everyone you vote if you are not around, so people that disappear, eventually will have zero impact (even if they are still voting).