It then becomes easier all else being equal for one large stakeholder to elect some witnesses

But we are not talking about "electing some of the witnesses". Sure they could get a few of their people in, but they wouldn't be able to get all 20 in like is possible (and easier than a model with 5 votes) right now.