Not holding the money that you call real doesn't make me worse than others who hold it.

(Excluding the elite who stole all their money) yes it does make you a worse of a person,
or more appropriately stated, the person with more money has created more goods and services that people desired to trade money for. Or, that person is more valuable to society.

A pot smoking layabout and a doctor:
Yes, they are both people, and equal under the eyes of god,
however, to society, the layabout is consuming more than he makes, or in other words, is taking more than he is giving. The doctor has given a lot of his time and energy to even become a doctor, and then still gives more than he is given.

There isn't any crisis or deficit of money currency

Yes there is. The currencies of the world are designed so that there is never enough.
For every loan, the principal is created, but there is not enough for the principal and interest that are needed to pay it back.

And this is what you really should be upset by.
You are being robbed, we all are being robbed, right out of our pockets without our awareness.
And this is what you hate.

Further, in the future, we will not live in a moneyless world. When we get passed money, it will be because we have a better unit of account of what we have given vs what we have taken.