Bleach will definitely kill wasps, but as with any homemade bug spray, spraying anything directly onto a wasp's nest is a surefire way to get stung. Instead, consider using a bleach spray only when there is an isolated wasp targeting you, or otherwise add a few drops to a vinegar trap to ensure any critters sucked under the liquid will perish quickly.