Building inside caves would be better, I think. Shelters would make less sense, but campfires, floors, chests and furniture would work nicely in a cave.