Just because he will not not go to counseling, does not mean you should not go.
That is a person that can help you work through all of this and give you some tools to help you communicate. If you are depressed, this person can help you work through this. Depression causes, exhaustion, short tempers and hormones out of whack... It is hard to work on a relationship, when you are hanging on by your fingertips just to care for your child.
Your focus at this point is anger and resentment. You can not get past it, till you feel like someone understands your feelings.
Your husband sounds immature. Is he young? How long have you all known each other? How long married? How old is your child?
The reason any of this matters? Some people get married really fast and do not really know each other very well. Some couples have not learned how to speak with each other instead of AT each other.
Also typically women are more mature earlier than men.
Men react to being a father very differently than women to being moms. We carry the baby for all of those months. The men are just observers. We tend to study up on what to expect.. men just think they can "wing it".. Or do not really think they will ever be the only caregiver.
Watching a capable woman be able to give birth to a baby and to be able to feed it from her body, can be very humbling to some men. They can be so overwhelmed they just feel unworthy or incapable.
So instead they work, they party, they argue, they make excuses and they hide.
The mature, secure men can verbalize all of this. But sometimes, we need to give them space, the freedom and the security to figure this out AND to admit it with us. This takes incredible maturity and acceptance on our part. .
Your husband has somethings going on and sinse he cannot share this with you, for whatever his reasons are, this will not change.
So go to counseling, figure out how to be secure in yourself and how to help your husband keep his masculinity, but to also grow up and face his fears and insecurities so he can be honest with you.
This is not an overnight deal. This will take time, effort and can be painful to face our own truths.