Yes, the thought of leaving your baby is heartwrenching. When we looked at daycares, we also liked Primrose School (we were looking at the Denton location). However, if you truly want to entertain the idea of staying at home with your baby, I know an excellent, FREE, budget counsellor who can help you look at your income and expenses to see if you can make things work on one income. This is not financial planning. It's real, practical budgeting. It's a ministry of Denton Bible Church. I did have to go back to work after my first child, but we got on track with the budget and by the time my second child was born (they're 2 years apart), we had things in such good order that I was able to quit my job. And I was the main breadwinner in our family -- my husband earns at least $10,000/yr less than I did.
Let me know if you're interested and I'll send you contact info for the "budget lady."