C.T.
Should you choose to go through New Orleans, the Aquarium of the Americas is incredible. Your little one will like it, too. The Aquarium is in the downtown/French Quarter area. It's actually fun walking around the French Market, too.
It's not so much "my thing," but if you travel through Vicksburg, MS there are a number of old civil war sites.