K.K.
Set up a time to talk with the Pe teacher. Use emails as a way to communicate or least start the communication. This gives you protection as a means of recodring what has been said and times, etc. I am not sure your district but find out wha tthe policies are in getting back in touch with you. in PISD they have to respond, even if it is a will get back to you within 24 hours of being notified by a parent.
And then go up the line of communication, princliple district representative, etc. To many time parents rush to remove their kids from a teacher, when many times communication could have prevented it. There wil be someitmes where you will have a teacher hard to communicate with and then and only then you should you go above them.