M.R.
There are so many things that are great about your post and in how you want to deal with the issue and the teacher. I look at this from a teacher's perspective, and I want to commend you for doing so many things right thus far.
You had the conversation about a month ago and have now set up a face-to-face conference. Great move - exactly what you should be doing. Based upon what you've written and how it 'comes across', if I were the teacher in this case I wouldn't feel as if you are being offensive and telling me I'm a bad teacher. What I would gather from the conversation, however, is that here's a student who is not comfortable with school and learning and what would *my* role be in helping her feel at ease. So, don't feel like you're going to be bad-mouthing him; I doubt he'll take it that way.
One thing that jumps out almost immediately is the kids being annoying and misbehaving. You will definitely want to ask the teacher about the social atmosphere. Maybe she is being bullied or picked on, but she isn't telling you? My gut instinct would tell me that she is either being picked on or excluded, she is struggling with certain concepts (although, she seems to be doing okay there), or that some event has happened that makes her feel unsafe and unwanted/unwelcome in the classroom. Maybe he said something to her that she misunderstood, and it made her feel badly? When talking with the teacher, of course discuss the academics but don't forget to emotional/social aspect of schooling either. Maybe it is a personality clash between your daughter and the teacher. If this is the case, this is a great opportunity to let her know that throughout life she will be working with people that she might not like or get along well with or click with, but you still have to work with them and make the best of it. I have had a few students, those of whom I really enjoyed, had their parents tell me that their kids think I "hate them". That's like a blow to the gut, especially when I haven't felt that way in the least! But most importantly, when it is brought to my attention I always think to myself "well, I must have done something to cause them to feel this way" and I correct it by having a positive discussion with the student: "It was brought to my attention that you feel as if I don't like you. I'm so sorry that I come across that way and I need to do a better job of showing you that this isn't the case at all!" (and I usually follow it up with some story about a great piece of writing they've done, talking about their strong points, or telling them how much I appreciate their contribution to the class).
When you go in to the meeting, be a good advocate but also be a good listener. After getting to the heart of the matter and the root of the problem, draw up a plan that addresses the issue. If it is a social thing, then the teacher can work on being more vigilant and making sure everyone is included. If it is an academic thing, then simple goals can be set to achieve the desired results. If both parties are willing, pull the kid into the conference and make her a part of the process. It will be an incredibly empowering experience for her to take control of the situation and try to 'right the ship' with both you and her teacher serving as advocates. Maybe she thinks that the "teacher hates her" (which, I doubt is the case) and this is a great opportunity for her to vocalize these concerns and he can allay her fears - what a great opportunity for her to learn how to communicate effectively with someone!
Good luck and hope everything works out well.