I would go to another doctor. My friend got breast cancer (family history of breast and ovarian cancer) and she had the gene. She and her sister didn't know if they were identical twins or not. She was tested, had the gene, and they found out that they were identical. Both sisters had double mastectomies and hysterectomies, and my friend was treated for cancer. Her sister has not developed it. They were about 33 at the time.
If you are considering something like this to try to prevent it, then definitely get the test. If not, I'm not sure what knowing will provide for you, and I would get a doctor that respects your history and is willing to be totally thorough in your exams.