I really wouldn't worry yet. A temperature of 103 is really not that high and means his body is trying to fight an infection (usually viral). The increase in body temperature makes the environment unfriendly for the infection, which is what you want. The vast majority of fevers are caused by viral infection and last no longer than 3 days. If the temperature gets to 105 then it could be bacterial. Fevers cause no harm, such as brain damage, when it is less than 107. Fortunately, the brain's thermostat keeps untreated fevers resulting from infection below 106. If he has convulsions, these are generally harmless, but there is a need to rule out a more serious condition (especially meningitis).
You do need to see a doctor if:
a. the fever gets above 105
b. if it gets hard to wake him up
c. if his neck gets stiff (associated with meningitis)
d. he starts getting convulsions
See a doctor within 24 hrs:
a. the fever gets above 104
b. burning or pain with urination
c. if the fever "breaks" and then returns within 24 hrs
d. the fever lasts for longer than 3 days
The best thing you can do for him is to try and make him comfortable. Make sure he is getting liquids. Boil a chicken with lots of vegetables and feed him the strained broth. Don't use broth you buy at the store. It's really not a problem that he doesn't have an appetite, but he does need fluids.
DON'T GIVE HIM ASPIRIN!!!! Several studies have linked aspirin and viral illnesses with Reye syndrome.
If you have to give him anything give him acetaminophen. This should reduce the fever by 1-2 degrees in a couple of hours. Keep in mind though that the fever is helping him fight the infection, so why try to help the enemy?
Good luck and I hope he feels better soon.
Most of the info above comes from "Current Pediatric Diagnosis & Treatment" by Hay, Hayward, Levin, and Sondheimer 15th Edition.