Yes, that is true - that's spot on. Although it is a matter of choice of who to listen to: someone with no credentials who is trying to build a following, or a scientist? And most scientists don't work for the government.
I think your core idea is indeed the core issue: lack of trust. But I think it is also a matter of degree: one might have some doubt, or one might completely buy into a conspiracy theory.
I think that people with political aspirations and pundits who want to grow their following have used the mistrust for their own purposes - misleading people. They are the ones who are even less trustworthy than the government or scientists.