A.H.
Funtime Junction in Fairfield is fabulous. I have a 2 1/2 yo, and she LOVES going there. There are push toys, toy cars, a toddler rollercoaster, and bouncy castle, and big indoor gym with tunnels and slides, an airplane ride, and playhouse, a play RV, arcade games, and more, including a decent restaurant. I think kids under 2 are only $5. Their website is www.funtimejunction.com
Oh, and as a follow-up to Parisa's response, the park in Paramus is called Van Saun Park. The other zoo is in South Orange, and is called Turtle Back Zoo - this is a really good zoo that your kids will love too. Lots of animals, a petting zoo, carousel, free train, etc. Very manageable for young kids. Most indoor places are geared towards older kids, but your 2 year olds will love Funtime Junction.