Both DH and I are not only not going to church, but we both do not believe in any god or similar idea. We raise our DD that way as well. We do not believe in the existence of God, a higher power, soul, heaven, life after death... you name it. We are both very scientific minded and many questions that come up we answer with a scientific explanation (death, conception, birth, evolution...).
Personally I don't feel like I am missing any "spirituality" in my life. I was raised catholic and stopped believing at a very young age - I always felt terrible having to "fake" it in church or in school in order to not stand out and avoid being bullied.
We live in a very liberal part of the US, so it isn't a worry in our everyday lives - as a matter of fact I don't personally know a single family in our circle of friends who attends a church, even on a semi-regular basis. But there are entire stretches of the US where we would not move to, for fear of being outcast or making it difficult for our daughter to connect. I also personally know people who got baptized and joined a religion because it made it easier for them to get a job (think teaching private school, private preschools...) - they didn't start believing, but they are doing a good enough job faking it.
I don't usually go around telling people that I am an atheist, because the people who know (close family on my DH's side) feel the need to constantly either want to proselytize us or the make condescending comments. Many people are very offended if you don't believe in any god at all, as a matter of fact one of our relatives has said things like "the only thing worse than being Muslim is not believing at all". It's like those parents who get mad at the kids who tell theirs that Santa isn't real...so I usually stick to saying we are "non-practicing".
BUT, with all that said, we still feel very lucky to live where we live. We don't have to be afraid for our lives or our kids because we don't believe and we don't have to fake it and lie about our non-belief in order to get a job or have friends. It could be a lot worse than some snide comments and derogatory jokes from people we see once a year.