L.G.
If your swingset and deck are wooden they might be carpenter bees which generally don't sting, they just like to drill in the wood. That said, my kids are still afraid of the carpenter bees even though we explained it to them. One thing you can do is seal the wood really well and then they aren't as attracted to it and might go away.
For the wasps if you can find the nest you might be able to get rid of it. A favorite place at our house for them to build a nest is under the siding if there is a little area that is lifted up they get right in there. Ugh!
Good luck.