L.R.
Please get a new attorney right now. I can't believe yours just said "Oh, forget trying to order a visitation schedule through the court." Your situation is exactly WHY courts have to be involved.
Your just "telliing" the ex the schedule means nothing to him -- he has no respect for or interest in what you tell him, so he needs the heavy legal hand of the court saying, these are your days and times. Then when he violates those days and times, it's on him. He of course will still try to blame you, because that's clearly how it is, but you will at the very least have a record of all his inconsistencies and lies. Then you will need to go back to court over his violations, which is not easy for you, but isn't it at least better than having to deal with him personally? Let the court and the attorneys handle this, even though your ex will probalby have a fit and make you out to be evil at first.
Get an attorney with a spine. Sounds to me like the one you used was too lazy to want to work on a visitation schedule.
You and he also sound like you need court-ordered mediation becuase he must, must, must stop bad-mouthing you to your child. This is incredibly damaging and you need to see that -- you must get the court to force mediation and the mediation must deal with the blaming and bad-mouthing. He should never, ever tell your child that Mommy refused to do X and it's all her fault. Sometimes a "no badmouthing" clause can be part of a divorce agreement.
You mention that this was your first time in court. I think you are FAR too soft on him, frankly -- the question is not "how do I survive" but "how do I get my child the best and least damaging arrangement here?" What you have now is damaging to her and to you, and he gets to feel he "wins" every time. Get a new attorney and get aggressive in court. If he blows visitation enough times and the court knows it, you might have grounds to seriously reduce his visitation which only sounds like a plus, to me.