Witnesses can reject a consensus-valid block if they want, and it's still a soft fork. From a consensus perspective it looks the same as the situation where a block is received too late due to network delays and gets ignored.

The only thing witnesses can't do with a soft fork is accept a consensus-invalid block.