Hi!
My son is 4 and he still seems to find those hidden pacifiers. I tried for 2 years to get rid of his. I tried the "fairy" thing, yeah, exactly, he's a boy. I tried the "oops, you lost it." My son can give you directions to the store. He also knows what aisle they are in. So, I started to limit him. I am a single parent, so my son goes away every other weekend. First, I took them away when he went to his dads house. Yes, I let his dad be the bad guy first...lol. Then, I took them away at his Nana's house. Then I took them away in the store. So on, so forth. Now, he is only allowed to have them at his babysitters house during nap time. No need to aggravate the sitter when she has him so much. I talked to the dentist and he said as long as I used the right size, my son wouldn't have any dental problems. I talk to the pediatrician and he said not to force it. So, he can have it at the sitters until school starts for him.
If you want it gone now...
My sister actually told her daughter that as she got bigger her "binky" would disappear. So, a little at a time, her and her husband would cut the tip. Just enough to be noticed by their daughter. Within a couple of weeks, the tip of the "binky" had vanished and there was no more. That was a year ago and their little girl hasn't touched one since.