Hi there, I have to say I do not agree with half of the responses here, because just to take your stuff and leave is not the easy way out. If you love him and he loves you, you just need to step out of the box for a minute and look from the outside in and see what you can control.
My husband and I have been married going on 22 years, I will be 40 this year. We have been together so long, since high school, that either we could grow together or grow apart, we both grew together. That doesn't mean that we haven't had our times of enough is enough, we have, there were times that we would tell each other we love you, but we don't like each other, or we would go weeks without having a normal conversation without an argument coming out of it. My husband had a lot of these same things you mentioned.
My suggestion is to take a deep breath and sit down and plan out what you want out of your relationship, write it down. Then on a separate piece of paper, write down all of the things you want him to change to help you get to where you want to be in the relationship. If he will, he needs to do the same. Sounds like you both are to the point of irritation that you cannot see clearly.
Once you write it all down, then take 1 thing off the list and talk to him about it, take it slow it is not going to change over night, I did this and it worked. There were things he needed me to change, and there were things I needed him to change.
The way I started it all out, I wrote a letter, put it in somewhere, either in his car, or at the coffee pot and go to bed early so he sees it... I let him know how exactly I felt, showed him the entire list that I felt very strongly for and told him I loved him so much and I want and need him in my life, but I could not continue the road we were on, for myself and my kids. That if he wanted the life with me and the kids that we needed to start working on our list 1 at a time.
We weren't happy, that we needed to get back to why we got together in the first place. It hurt like heck, it was very emotional for awhile, but it ended up being the best thing I could have done, because he started to look at me in a differnt way, respecting me and my decisions better and being more involved with everything.
I can tell you we have had a few spouts since then but nothing major, when you respect and appreciate each other it is easier to handle the stress of life.
My husband had told me back then the reason he acted like he did was because he was so stressed with work, taking care of the family (granted we were really young)that he felt like he wasn't doing enough and that I didn't understand where he was and what he was going through. You know he was right, but he didn't know what I was going through either...its called communication...you just have to find the right way and the right time to make him listen to you. If that doesn't work and you truly cannot be happy then you need to gain the strength and make the decision whether to leave for you and your kids...but you have to be 100% ready, I am not a believer of take the kids and shock him...because if you go back and things do not change then what happens next time? You do the same thing and he doesn't believe you and nothing changes because you already came back...
Good luck and I will pray for you.