Hi M.. In my opinion it's a little too soon to have your son spend hours (even only a couple) in front of the tv. I understand watching sports with his father, which is very sweet and a bonding thing between them two, but i would limit the amount of time he spends basically sitting down and staring at this light coming from the tv, whe his father is not around. The reason why is because there's no real interaction between the tv and the child, so he is "passive" and he isn't doing anything worthwhile for his development.
Plus, there are some images on tv that toddlers (but I would say children in general) cannot comprehend (for example those commercial about the latest trashy reality shows) and can cause discomfort or aggressive behavior. For my son, I let him watch a couple of cartoons in the morning while having b/fast, he knows that after cartoon no. 2 I turn the tv off and it's time to get ready for school. During the week, if he has been a good boy and deserves a prize, then I'll take out the dvd player (a portable one) and will let him watch a Disney's movie of his choosing (I have many that I have selected for him) - that happens usually when I need a nap (so he doesn't roam in the house without my supervision) and when he needs some resting too. Never during the weekends because then is when I keep him busy the most. There's a series of excercise books called "high five", you can sign up and they'll send them via mail: there are so many activities in those magazines, they'll help him to find hidden objects, learn shapes, numbers, letters and ethical behavior. Also we do coloring, playdough sessions, we play "memory" with the matching cards, we play ball and read books.Obviously he has some playtime alone by himself in his room with his toys, but often I try to invite other children over, so he' s happier. Could you pair him up with a friend of the same age?