I think that you need to think about this differently.
Right now, it really sounds like the 2 of you feel as though if you don't get your way, you "lose" and your partner "wins." That is not a good way to view major decisions that effect the whole family. (And believe me, I understand exactly how this happens, LOL).
Also, I wonder (just taking a stab), if part of the reason that your DH wants to stay is to prove that you (and specifically he) can do it, and haven't made a poor decision.
You both need to sit down and come up with some compromises. I think that if you belong to a great church, it's time to start using that church to help you build a second "extended family" there in NC. At the very least, this will help you now over the next year. Get to know other families--offer to swap babysitting so you and DH can get some time alone to do FUN things, etc. (and FUN can be free! Do a little research in your area, and you can find all kinds of fun things to do that don't cost much or anything).
In the meantime, set aside this decision. At the very least, you can't do anything about it for the next year. Yes, you're not happy where you are, but your DH is. If you make more of an effort, you may find that you can be happy there, too. You owe it to yourself, first and foremost, to try to be happy & make friends and a new support network, and you also owe it to your family.
Meanwhile, lay off the discussions about moving and tell DH that you think that you both need a break from these moving discussions, so you want to leave it alone, and come back to it 6 months or a year. Put it aside, not just verbally, but in all ways (try to avoid thinking about it all the time, etc.)
When you do come back to it, focus on the whole picture, not just what "you want" and "he wants." Ask him to help you come up with solutions to the issues, both the family issues (debt) and the other issues (lack of support network and/or friends). Tell him how you feel, but don't place blame on him.
I wish you luck... It can be miserable living in a place you don't want to be, and just awful when you have all this financial weight crushing you down....
On a side note, you might check out www.cannywomen.com for some great tips on how to save/conserve; as well as The Tightwad Gazette, great book on ways to being frugal.