R.C.
Jumpsters on Peachtree Pkwy and Sharon Rd is pretty good. Kids jump on inflatables. I've also been to some Big Air birthday parties, off McFarland, that were also fun for the kids but I preferred the seating area for parents at Jumpsters. The Forsyth Family YMCA, off Post Rd, offers parties too. http://www.ymcaatlanta.org/uploadedFiles/BDAY07.pdf
Parties at home can be a lot of work but I prefer home parties. At some places, like Chuck E. Cheese, everyone has fun...but all the kids go in different directions and I feel like they are hardly together. I've had some parties at home with magicians and it's a big hit. Also kids love Pin the Tail on the Donkey, a pinata, limbo, musical chairs, making a craft. I've also had a birthday party for an older kid at the movies, even getting a tour of the projection room. Your guy is probably too little for that. Good luck!