yeah, so just abandoning anti-abuse and not more people joining anti-abuse efforts (not caring) wont bring us any further

I downvote more abuse than they do on a daily basis. There is a handful of other people doing some as well, but largely most people don't want to be involved or risk losing upvotes.