If you really want to ruin a bandit's day, you could always build your house floating on top of an acid lake.
Just make sure you have a way to avoid the acid.
