I do not understand, were you just growing some plants in an empty house lot?

Normally if you own the property people would not do that.