Like already mentioned, he may just not be ready for solids yet. Until he is, give him his bottle and keep slowly introducing the spoon every now and then, and I promise, he will let you know when he is ready.
Remember that the sooner you introduce solid foods, the sooner you introduce food allergies. Wait until he's ready, which may not be until he's 6 months. And that doesn't mean that on the day he turns 6 months he'll be ready, but try to wait as long as you can. Just keep trying a little at a time, and make sure you aren't replacing a feeding, but instead supplementing a feeding. He may just not like the idea of solids because he thinks it means no more bottle. So make sure he gets that bottle as well, not as much as he'd normally get, but just enough so he knows you aren't taking it away.
Also, it may be easier NOW to start with fruits, but don't! You want to start with veggies (one veggie a time, for about 5 days!), because right now he doesn't know that fruits are sweeter, but he will the second you give it to him! Try giving him apples and bananas, then carrots, and you will have a much harder time with the carrots. Start with the carrots and peas first so he doesn't know he's missing something sweeter!