I know the word has taken on a life of its own, but it still grates on me because it besmirches the word "truth" by association.

I'm pretty sure that the context of the two words leaves no doubt in people's mind that a "truther" is not someone who has a keen grasp on "truth."