I have the same feeling of insecurity when I couldn't continue going to a university after high school because my parents couldn't afford it anymore. Yes, you shouldn't let others put you down because of you're situation. If you want something, work hard for it and everything will fall into place.
RE: Words that turned out to be a treasure...