K.L.
I am currently being treated for tonsilitis with a possible abcess (I have had two injections of steroids to reduce swelling and am on a heavy antibiotic after she tried to drain the area by cutting). I suggest calling the ENT back and explaining that your swelling and pain is asymetric. When I told the doc that, they immediately became concerned about a potential abcess (since tonsilitis is typically on both sides).
In my case, the fever ebbed and flowed but the swelling never did. I go back to the ENT on Tuesday. If things aren't where they need to be, she said she'll do a CT scan to make sure that there isn't something still there.
Hope you find some comfort soon :)