An apatheist would probably have no problems with having their baby baptized, so long as someone else took care of the details. An atheist might.
It depends on where you live, also. In some places it seems people get asked why they weren’t seen in church, or where they go. That never happens where I live.
But to the outsider they can look the same, which is kind of my point.
Anyone making the leap into a new faith is going to be gung ho for that faith as a part of self justification. I think a new atheist who starts hitting the message boards in support of atheism is more like that. What I was talking about is the reaction to the fear of hell that appears to be part of many sermons. That’s different.
Being Jewish, and not having hell, I never experienced this problem, but I believe those who say they do. Many say it is the one thing keeping from breaking all ties with religion.