"...why can't my account be recovered in the same way if I've lost my keys?"

That is a good question! The answer is that possession of the OWNER KEY counts as "proof of ownership" of an account. If one loses it and cannot submit it as proof of ownership, then the recovery process would fail.