The argument that using "racism" is bad seems like it comes from someone who has lived in a cellar all their lives and never interacted with humans.
Putting aside the issue of you raising racial IQ, a highly contentious and misunderstood topic where the basic 'fact' in no way encapsulates the truth of what is going on - there is nothing that makes truth mutually exclusive with racism.
I know plenty of people who have tried to use the "I'm just stating facts argument before", like people who for some reason like to just post lots and lots of articles about people of colour committing crimes but are never interested in doing the same with white people committing crimes. In that case although the individual articles may themselves be factual, the desire of the individual to continually use facts to attack particular races is itself indicative of racist viewpoints and individual facts are not themselves address the overall POV being hinted at.
This really just seems like a way for people to avoid criticism and critical analysis of their points of view and be able to say racist stuff without being challenged. If you say something that is deemed racist, you should be able to defend your statement on it's own merits and not retreat behind "But it was a faaaaaaaaact" because facts are not mutually exclusive with a racist POV. Do you think no racist has ever used a fact to support hatred of another race?
An example of this (though using a superficially harmless slogan rather than a fact) can be found in the "All Lives Matter" slogan used as a response to "Black Lives Matter". By itself and devoid of context it can be viewed as an affirmative egalitarian statement. In context however, it was actually used to dismiss issues with discrimination against black people and show that all lives didn't equally matter. Afterall, if someone was lamenting the death of a loved one would you say "Oh don't you know, lot's of people die all the time, ALL LIVES MATTER"? No it would be horribly insensitive. If a Jew was remembering the millions of Jews lost in the shoah, would you say "Don't you know lots of ethnic groups have faced genocide and even been wiped out entirely? Why are you focusing on one group? ALL LIVES MATTER!"? No, again it would be horribly insensitive and the action of trying to criticise empathy for a tragedy of that scale would be monstrous. yet for some reason some people think it's perfectly acceptable to use that slogan to shout down people raising their voices about black deaths. In some circumstances's, based on context, it's therefore reasonable to conclude that All Lives Matter is a racist slogan..