M.S.
Yes, you can swim. There is no way that swimming in a pool will effect your milk. Sometimes the milk tastes different right after exercise though, so if your baby acts funny, just make sure to shower and maybe wait 30 minutes. Mine were never bothered by exercise but I've heard this from others.
Enjoy swimming!
M.