I think he is saying nobody is sending him threats and calling him slurs because he isn’t a minority, but still acknowledges the problem of others.