Nobody thinks those specific views are racist as stated, with no other context. But neither were they what he was challenged on in the relevant threads.
To pick an analogy not related to that poster, imagine if I said “I’ve been called racist for stating the belief that the voting population should be literate”. There’s nothing racist at all about that belief…until you discover that what I was really doing is defending Jim Crow laws. Context and framing are important.