Hi J.,
I wouldn't necessarily get rid of it right now. Your son is going to go through a lot of different stages in the coming months, and the pacifier may provide a lot of comfort to help him through those changes. My son is just over a year and while the thing was a pain in the beginning, I'm really glad he's had it to help him through those "anxiety" stages (separation, sleeping through the night, etc...). Your son should be able to start putting the pacifier back in his mouth on his own in a couple of months. Once my son was able to do that, I would keep an extra pacifier in his crib at night, or just before I went to sleep, I'd go check on him and put one in if I couldn't find his other one (sometimes his would fall out of the crib after he fell asleep).
We only give our son his pacifier when he is going to sleep. During the day and playtime, we usually keep it out of eyesight. However, I will fully admit that there are times when he's in new situations (play dates or parties), where I'll bring one with us to help transition him into a new environment.
We plan on having him give up the pacifier by his 2nd birthday. I think it will be a lot easier to break the habit when he is old enough to understand that I'm taking something away because he's a "big boy" now... as opposed to just taking it away cold turkey without explanation.
Anyway - I hope all this rambling helped!
Good luck!
D.