M.O.
You can either continue to pump and don't drain your breasts, thereby diminishing your supply until you are dry. If you're already pumping so infrequently it should dry up relatively fast I'd think. If you don't feel any "lumps" in your breast, there shouldn't be a blocked duct that would become infected. If you do feel a lump or discomfort, you can pump and massage that area to release the blockage...sometimes going in the shower first helps. You use warm water on the area, gently massage it with soapy hands to loosen up the blockage. Then pump afterwards and you can also apply a cold compress.
Or, if you're looking for a quicker solution, you can take some Benadryl or Claratin...these will dry your entire body out chemically, so your milk will dry up too.