Sometimes we punish ourselves by thinking that 'letting go' is giving up, when in reality it's a form of self-care.
It's exhausting trying to hold onto something that can no longer hold itself up, but as you rightly say, that emptiness What remains is where we really begin to grow.