Hi M.,
Well, it sounds like you have done a lot of thinking in regard to this suggestion from your midwives. Of course, if all goes well, things sound fine.
As someone who had a home birth, I really cherished the experiene of having my partner able to tend to me in those moments I needed some extra grounding and connection. I don't think I would have had the same experience relying on a midwife for those moments, especially ones I had only known for a few months. I would certainly say too, that some labors can go long and the midwives will need to rest so that they can be at the top of their game. If one gets called off to another birth, they may not be able to take turns, and for the people who are supporting a laboring woman, this time can be long/exhausting.
Here are some things I would consider:
With this birth, do you want to be connected with your husband or midwives? If one or more of the midwives has to leave to another birth, will you feel the same about this? What does your husband feel in regard to being sole caregiver and wanting to be supporting/participating in this birth?
And more to the point, if for some reason you had to transfer, would it bother you if your husband wouldn't be there for, say, a cesarean birth or whatever other interventions might be necessary? How would he feel being excluded from those things, and would he want to be in the position of not being mentally and emotionally present for your daughter?
I do understand your desire to include your daughter. If it were me, I would start asking around to find a person or doula who would be willing to support your husband and do childcare. There are some doula schools in town that have students for a lesser price than full-cert. trained doulas.
This way, your daughter can be included and your husband can better participate as your partner.
Best blessings on your upcoming birth.