Yes, you can. In fact, we recommend bathing to remove any dirt/chemicals from the kitten, and in underage kittens it may be the safest way to remove external parasites such as fleas (note that many medicated flea treatments cannot be used on underage kittens). The most important thing to remember is NEVER let the kittens become chilled. Additional bathing instructions are available in the webinar we created for Alley Cat Allies, Advanced Feline Bottle Baby Care.