Yes it would be the case, for various prejudices.
I think the sooner that persons stop attacking others beliefs for no particular motivation, and dropping irrelevant comments in every conversation about a religion or a non-religion and show simple respect, whether it is for the belief or the non-belief, that life would be better.
As it escapes me to know what your athiesm belief has anything to do with the word moslem or the word muslim.