I think we are better moms when we are better people - and I think our kids do better when we are in better shape. So I disagree with those who suggest that you just suck it up and enjoy it because you will have all kinds of time when they go to college!
Your "quality family time" will be of great quality if you take some time for YOU, not just you and your husband, now. You both are entitled to alone time, and if you don't take it, you wind up where you are now, feeling deprived. It can also lead to resentment of the spouse - "gee, I'm always here for US but I never get time alone." So you are wise to try to head that off now. I also think it's vital that kids grow up learning that their parents are real people, with needs and lives beyond parenting. It sets them up to be better adults and take care of themselves too.
I'm not sure how you are managing time to meditate when you don't have enough quiet time to think! I know that space is a huge factor too. I'm a big user of the public library - so few people are now that the internet is their substitute - but it's a huge resource. Your profile says "Chicago" so maybe you are in the city vs. just outside. But university libraries are awesome, and so are their open spaces and courtyards. One of our hospitals has a huge lobby with a waterfall that pretty much drowns out surrounding noises - a lot of people use it for reading and contemplation, just choosing a seat that allows them to turn their back to the foot traffic. I'll bet you can find some great areas if you take some time for yourself to explore.
What I did, made easier because my husband worked at home, was take 2 days a month for ME. I took my son to preschool, left the car seat there, and took off for ME time. My husband would pick up at preschool, bring our son home for lunch and bonding time, then put him down for his usual 3 hour nap and go back into the home office. I usually got home roughly around the time our son woke up, but if not, my husband was right there. So for me, it was a 6-hour window of real time. At first I wasn't too smart and I used it to do errands, but then I decided that defeated the purpose. So I went to an early movie (me and 3 senior citizens in a dark theater - it was great!) and even took myself to lunch. Believe me, lunch alone is great! I took a book or a bunch of crosswords, or a journal. I always asked for a corner booth, or even something in the bar area which, at 2:30 PM after a movie, is not usually crowded in many places. In good weather, of course, I went to nature areas, but even a decent walk in an area where you don't run into friends and neighbors is great for reflection.
So my 2 long breaks per month were really sacred time.
My neighbor used to take her showers at the gym - she'd go to a class or use the treadmill, then take a long shower there when she wasn't worried about running out of hot water or having someone interrupt her for a glass of juice or to referee a fight. It was worth it to her to take her towel and travel shampoo and flip flops, and just linger in the locker room drying her hair.
I'd skip the 2nd book club - it's not really alone time at either club. It's adult time, which is great, but you are already struggling for time, and to fill it up with 2 books to read on deadline might add to your pressure. Instead, go to the library and just read there in total quiet - a book of your own choosing, or just browse the stacks there and find something that's not a bestseller but which really interests you.
And don't give up the exercise - find a gym with child care or a mother's helper to keep the toddler occupied while you take that time!