Those are not the reasons you don't fit in.

Plenty of people think for themselves and not just fit in, but are hugely successful. Exactly the same can be said about not caring what others think.

So, while I am sure those things both of those things are true for you, they are not the reason you "don't fit in".

The real reason people usually don't fit in:
They look down on others.
They do not view their peers as equals.
Consciously. Subconsciously. Doesn't matter.

Let that simmer for a bit.