Yes. The ego mind can easily mistake a state of inner silence with thoughlessness, unproductivity and death, especially in a world where many people feel like needing stress to feel alive. From such a person's perspective, inner silence is dreaded.