try to help them find a place like a shelter or a soup kitchen.
Ignoring the poverty around you, or making judgment calls about the people in poverty, is a surefire way to do nothing to help. You don't know how that person got into poverty and you don't know what they are going to use their money for.
If you are afraid of what they are going to use your money for, you can offer them something (e.g. to buy food, give them a job, buy clothing, etc.). This way, you can make sure that they get what they need without using your money for something bad like weapons or drugs