It depends, people's ignorance of the laws that govern them isn't an excuse, in certain regards verbal agreements are legally binding.
Now you're talking about fraud or duress, that is completely different and these are criminal offenses, and cannot be conflated with agreements.