And so, we have become trained to expect that our lives mean that there is ”lots of stuff going on” at all times, and when that stream of constant stimulation stops happening we're disturbed by it.

Very true! And that's why the lucky ones like you and me enjoy so much exploring deeper the immense world that lays in our inner selves when the external world stops. :)