Walking backward into the dark and bumping into a locked door looked like the game quietly closing a trap behind you. I see missing the puzzle in front of the shrine was such an easy mistake.