M.L.
I have fibroids, as well. How much they affect fertility depends on where they are and how big they are. Mine are on the uterine wall, and while they don't prevent conception, they do prevent me carrying to term, as they rob the baby of all the nutrients.
It's definately worth seeking out a doctor's opinion. It may cause a problem later in the pregnancy.