Hmmm
I don't think it's nice to downvote because of the reasons stated above.

Everyone should be entitled to his/her own opinion.

We can enforce/impose our ideology or believe on everyone in the community.

Things won't work or move that way.

There won't be unity/togetherness.

Things I believe that would make a community increase is;

When we share common goals

When we have Freedom of expression.

Attend to each member concerns with sensitivity

Have a clear policies and obligations which I believe is put in place

Fairness, don't just downvote base on individual differences

Further interaction among ourselves.