One of my favourite parenting advice quotes is:
children help us by using resistance to show us what is not working.
You are right -- something is not working, and your little guy is stressed out. I want you to think about the thing with the pacifier from a logical, compassionate viewpoint (rather than taking impersonal advice from some helpful book that has no connection to your son, your family, his history or the real world):
Not a million years ago, you offered him a pacifier so he could soothe himself (we can argue later about whether or not that is an appropriate goal with small children, but here is where it started)... he grew attached to this object of soothing because you encouraged that attachment.
Now, for no reason other than the earth has gone around the sun a particular number of times (and let me make this point very clearly: an ARBITRARY number of times), he is no longer allowed to be in need of soothing, he must stop being attached to the item he was encouraged to attach to, or he must grow up in the space of time you have mentally prepared yourself to accept (instead of at his pace).
What are you going to replace this object of self-soothing with? Because 'nothing' can't be the answer, unless it comes with the natural association: he's not allowed to be soothed anymore.
Your little one is anxious for a very, very good, clear reason. The question is, will you have the courage to be wrong and change your mind to ease his anxiety, or will you take the 'I'm right and your response doesn't matter' route instead? One of these is the hard road... guess which one!