Seriously, relationship should be about love and mutural respect. If he loves you and you love him, for such a long time, that shouldn't be smth to just "dump" and "throw away", it should be always smth that you treat with respect.
In the country where I come from ( Germany) it is very common that women are more religious then men. Some of the men, despite the fact that they are not religious, still attend to church, most often because they respect traditions and later want their children to grow up in a "normal" enviroment.
Their non believe is not a big deal here, our communities are very tolerant, as long as they have mutural respect and no one tries to missionary the other it works out fine. Children are raised catholic, but even in religious class they are confronted with all different religions and also atheism anyway. Later they can choose what they want to believe in, if they choose to become atheists it's mostly because of own thoughts or friends, not because of the father.
Of course, your community plays an important role in all that. If your close friends and parents would accept him as he is, it will most propaply work out well, as long as you keep love and mutural respect. However, if they think he is destined to go to hell and all atheists with him, they will never understand how you could endager your children to something like that, and never accept him or your decision for him.
Here most christians believe you go to heaven when u have lived a good life, so they will judge your husband rather by that means, and not if he is christian, jewish or atheist.
No matter how you decide, I wish you good luck on your way.
