I don't really trust consensus because most people are ignorants (myself included)

This is a fair point, I think: most people are ignorant in many areas of knowledge, in part because the space of knowledge is so vast that most of people's knowledge is just other people's opinions, believed because of simple consensus, and insufficient critical thinking was applied to many of those originating opinions. Before the establishment of the science, many of humanity's beliefs about the world were quite wrong, for example, since simple consensus was often enough to persuade everyone of some idea's truth and a single persuasive person could sway a lot of people to unfounded beliefs.

Also, the more we believe in our own critical thinking abilities in various domains, especially with respect to the abilities of others in those areas, the less we trust consensus opinions when they disagree with our own opinions.

But nonetheless, I think almost all of us rely on some people's consensus opinions to help guide our own at times. For example, I'm pretty good at math, but if several people who I believe are good at math tell me I've come to an incorrect result, then at the very least I'm going to recheck the steps in my analysis. And if I'm in an hurry for a result and I think we're all nearly equally skilled, then I may just take their analysis over mine, since the odds of all of them being wrong is lower than me being wrong.