I don't think you need to do anything different, you just need to accept that you have moved on and grown and they haven't. I think setting hard limits for yourself is smart and you shouldn't have to worry about letting them down or being lame. When are you really going to see this guy again?