I think it has something to do with the highly paranoiac nature of transphobia! Because they are anxious that they cannot in fact “always tell,” there is a possibility of more trans presence than they can perceive - and because everyone’s gender performance is implicated, it is uniquely deranging.