Since religion is something into which children are indoctrinated, rather than born, there is no reason for athiests to kill babies.
Other than to save them from the burdens of religious delusions. Where Chistians might be killing them because of the burdens of religious delusions.