Voters who supported these ideas may later feel the pain but often blame the wealthy for leaving rather than the policies that prompted it