I know you stuffed the opening with rocks, but my guess is that that critter will dig around them and nestle back in. Then he'll say, "Hey man, thanks for cleaning out my outhouse!" 😃
Just an idea if he comes back, sprinkle a ton of cayenne pepper all down in there. Critters don't like that and he might move on.
!LUV