If you assume individual freedom should be the ultimate goal of a given society, then you should recognize most policy making is deviating from that goal.
Policy making is a dance between policy makers and groups of interest, always directed at providing special benefits for those groups, diluting individual freedom along the way.
Hence, policy making is a harmful exercise.
What'd be interesting is a base set of rules to protect freedom, which'd be immutable. From that point on, every policy making, if necessary, should be consensual. This would prevent sneaky groups pushing their agenda.
Also, can we skip politicians?