Honestly? I think they wouldn't REALLY kick him out. They were likely just trying to get him to speak up and stop torturing himself.