I wouldn't call John Locke, Montesquieu, James Madison, and Thomas Jefferson anarchists - but all agreed with the above social contract.
The question then became putting into practice. And, as everything in real life, there are pre-existing conditions; there are people that disagree with you to an extreme that you may need to make compromises with. ... Or nothing get's done.