I've got four girls, and have never had to go to the ER. A fever means the body is fighting off an illness - it's a good thing. Yes, it can cause damage in babies if it's too high for too long, but I don't think 101 or 102 is too high if it's only been for a few hours. If it won't go down with washcloths and drinking water/nursing by midday, then I would say you could give some homeopathic meds.
If you think it's teething, Hyland's teething tablets are WONDERFUL. They take care of low grade fevers, snotty noses, and teething pain, and are completely safe. I have no trust in Tylenol or Motrin being safe for my babies. If there is no change by afternoon, especially if baby is not drinking, then call your doctor. They should be able to give you advice and get you in if they think it's necessary. The ER would be a long, expensive, drawn-out headache.
Your cuddles are the most comforting thing for him, so stay close!