Libertarians are not anti-government, they are pro-limited/small government. As it pertains to the United States, they are advocates for the Constitution, meaning States' rights, small Federal government, etc. If you are an anarchist demanding "purity" (aka AnCap, no government), please show yourself out of the Party.
Read next
From @bannister2020