I work harder than you so it's not a fair exchange

When social value is measured in things other than dollars this isn't an issue.
It will be easier to get somebody to build you a mansion if you are valuable to the community.
If you are a bum, good luck not getting rocks thrown at you.

The neighbors know who the bums are.
Strangers from out of town will have to prove themselves valuable to the community, or get rocks thrown at them.

this was more costly to produce

There are no costs beyond labor/time costs, if you are wasting somebody's labor/time the neighbors will think you are a bum.

Honestly, I don't need a man in a suit and tie to hire some thug to hit me with a stick to behave well.
When behaving well is rewarded as wealth, and the bums get rocks thrown at them, deportment of the general population won't be an issue, imo.