
The odd man/one out
Feeling Different
Used when feeling or being perceived as not fitting in with the rest. 
Neutral Tone
The phrase is neutral and doesn't imply any negative judgment or exclusion. 
Group Context
Mostly used referring to a person's situation in relation to a group. 