Most people around me seem to be confused about that. An easy way to check it would be to take the other person out. Would you say "Give it to I." or "Give it to me."? Adding the person doesn't change the way you would refer to yourself in that example