Without a splatter shield, this is a possibility. If you don't opt for a shield like Spray Pal, practice using the sprayer on a clean diaper (or just around the toilet bowl) until you get used to the water pressure and the angles you'll need to spray to keep it from splashing or making a mess.