R.J.
Sounds to me like he called his lawyer and his lawyer said you weren't responsible for dropping her off.
Personally, I'd also call YOUR lawyer.
To me (not a lawyer) it sounds like the judge ordered a "ditto" of the other midweek visitation. Meaning that since the practice was for your x to pick up and drop off, that reasonably one could expect the same conditions to apply.
ALSO it might be handy for your lawyer through your x's lawyer to highlight the verbiage is MAX (as in "up to") of 4 hours, not "must be" or minimum of. Also that if your ex doesn't return your daughter BY 9pm (as in threatening to keep her overnight/ not returning her unless you come get her) that he would be violating the agreement. Which could get the whole thing struck.
So yah... talk to your lawyer.