I agree, but I try to stick to downgrading the comment/argument instead of the people themselves, because I’ve found it to be a pretty ubiquitous line of thought since I started noticing it.
I was listening to an episode of Joe Rogan, and the guest considered himself a conservative.
Discussing the differences between a conservative and a liberal he used an analogy of a fence, where a liberal would want to take it down and a conservative would want to leave it up.
