Cats do not urinate inappropriately out of "spite" because they are only "behaving badly." it is common for cats to urinate outside their litter boxes when anything is amiss with them or their surroundings. There are also minute crystals in the bladders of some cats, which might irritate the urinary tract.