A.P.
I am so sorry. Life, kids, money all put stress on a marriage.
My first piece of advice would be to seek counseling immediately. From the sounds of it, both you and your husband are confused and frustrated beyond belief and your life is like an ocean current pulling you too fast to get a solid grip on the situation. Second, go out of your way to meet him where he is. Marriage is not 50/50. It is 100/100. Little things and big things - I'm sure you know what they are. Do it. Meet him there. Perhaps he's feeling like a failure because he knows this is the road you are traveling on and all it'll take is a little something extra to show him that you're willing to give him/your relationship another try. No one is perfect. No marriage is perfect. Be willing to admit when you're wrong. Consciously look on him with affection.
Once you've both been to counseling and gotten the junk out on the table, then if you both continue to be miserable or he continues to be verbally or physically abusive - then and only then can you exit with a clear conscience knowing that you really did try everything and it just didn't work out. You are the only person you can change. But you have a lot of power and influence over those you love. You must set a good example, sacrifice a little of your pride and make the effort first. Both of you have your guard up, which will never make a marriage successful. It takes two people to fight - remember that.