J.T.
No, not being selfish at all. You are allowed to want a child, and he is allowed to not want one. It is a decison you need to make together.
You are both young yet - you can wait a few years before any decision is final (I was 39 and my husband 50 when our daighter was born).
I wish you luck...