J.N.
When it flares up, I do Kegel exercises. I just focus a little more in the back area. My reasoning is that it helps get proper blood flow through everything, plus it seems to help hold things back into place. I don't have anything that says it works, but symptoms usually calm down within a couple of days. I've never used any ointments or creams, but depending on how bad it is, you might need to.
Hope this helps a bit!