Your little guy might not be ready for solids yet. Most MDs recommend waiting until babies are 6 months old before starting them on cereal/solids. There really is no rush. The research shows that cereal doesn't help babies sleep better. In fact, if you start too soon, it can upset their tummy and give them gas pain.
Personally, I didn't introduce any solids to my daughter until she was 8 1/2 months old. When I did introduce cereal, I mixed it with breast milk and fed her from a bowl. She hated it. It took me two weeks of trying to figure out that rice cereal just wasn't her thing. She loved oatmeal though. It wasn't long after she started eating oatmeal that I introduced other food to her. She loved fruit (especially peaches).
It was exciting trying out new foods with her; however, figuring out what and when to feed her was a lot of work (at least for me as a new mom) and felt like a chore at times. It made me miss the days when all I had to do was offer her breast milk.
I'm sure everyones experience is different. I have friends that started solids sooner and it worked out fine for them. I was glad I waited. Today, my daughter is 15 months old and is a great eater.