C.C.
My suggestion is to reach out to the local Master Gardeners group. This is a group of volunteers who have been trained via your local state university, and can give you advice that is specific to your area (i.e. what types of plants a beginning gardener can grow, when to plant them, what types of bugs and plant diseases to watch out for in your local area). Often times, they will give lectures on various subjects, and all of their lectures are research-based (in other words, the advice they will give you is proven scientifically, and not just urban myth :). Most of all, Master Gardeners LOVE to talk about gardening! They are a fantastic resource!
In the most general terms, my theory of gardening is that I like flowers, so I plant things that flower. You may like shrubs that are just a pretty green, or maybe you like interesting foliage... the sky is the limit and it just depends what you like! Ask around and find a *good* local nursery (not Home Depot). Before you go and buy a ton of stuff, do your research. Find out what kind of soil your new house has (clay soil will be very hard to dig up, and retains a lot of water, sandy soil is very easy to dig in, and water drains immediately from it). You'll save yourself a lot of grief knowing that, and knowing what parts of the yard get full afternoon sun, vs morning sun, vs all day shade, etc. Some plants like lots of sun, some don't. Some plants love clay soil, some (like roses) hate it. Research first, buy later. The other thing I can suggest is, know how big the plants will get that you're wanting to plant. For instance, you might buy a lavender plant that is in a little tiny pot - depending upon the variety, lavender can get really big! So think about that before planting it right next to something else - make sure you allow room for it to reach its eventual size.
I know that doesn't even scratch the surface, but gardening is a pretty vast subject, and I know that what I'm planting right now is going to be very different from what you will have success with where you live. Go talk to the Master Gardeners! They will help you! Good luck!