Boldly express your opinion. And you need to know what you stand for. If he refuses leave the place for him.

It is really unethical and uncalled for, for a boss to be demanding for sex in an office.