Do you work full time or plan to pump exclusively? If yes, then you really need a double electric pump to keep up with the demand for milk.
If you are a SAHM, then you can get away with a manual pump for occasional feedings.
You can use other bottles, in fact, you may go through a couple of bottles before you find a nipple your little one will take, so don't buy tons of bottles and open them before you even try.
For a manual pump, I had an avent isis. For an electric one, I would definitely get a Medela. They are great pumps. You can look for one used on craig's list or ebay and replace the parts, but I would just get a new one. You can go to Baby, Mother and More at Gilbert and Southern. They sell the pump for about $270 there where it's over $300 at BRU. I know that sounds like a lot, but formula is a lot more expensive, so if you are committed, and answered yes to the first question, you really should make the investment. Especially if you are thinking of having more kids.
Good luck and congratulations!