Situations with Your Baby in Resteraunts- Advice Needed...

So here is my rant, dilema, or quandry... Two days ago my mother and I were in a very nice but not upscale resteraunt with my 2 month old son. He was sleeping in his carseat when we arrived and ordered. Half way thru our salads he woke up and was a little fussy. He would wimper a bit and move his arms and legs about. I did not want him to get loud, so i took him outside where there was pleasant weather etc. Once he went back to sleep i went back in to eat my meal with my mom.

Inside the man in the booth behind us began to make very cruel comments. He was often loud, and said things to the effect not everyone should be a parent and that my son was obviously to young to be at a resteraunt. - this is a rib place where people eat on picnic tables and booths decorated in honor of a pig, not tavern on the green.

My mom took the baby outside to avoid this man while i tried to finish my meal. He tried to engage the people at the table adjacent to ours about my shortcomings as a parent for having the baby out. He was quite loud and very embarassing. I stopped eating, gathered all of our things and asked for the bill.
Not knowing how to react, but wanting to beat him to a pulp at this point, I also paid his bill. I waited for him to comment on who would have done such a thing, and replied i did. I told him in a loud voice i apologized if my 2 month old defensless baby had ruined his dinner, and it was the least i could do. I also politely thanked him for having the kindness to ruin our evening out, as i had so simply ruined his by procreating and trying to have a meal with my terminally ill mother. The people at the neighboring tables were snickering at him, which gave me some bit of relief. I kept an even apologetic tone, but inside i wanted him to realize the impact he could have and never do it to another mom. His girlfriend was very embarassed, and tho i did not loose my temper, I am at a wits end at how to handle these situations. Has this happened to anyone else, how did you handle it?
I often wonder if they forget they were once babies?