Caulk remover is made up from many different things. You have removers that are chemically based and made of benzene, alcohol, propane, and other harsh ingredients, and you have removers made from citrus oils, citrus extracts, and natural ingredients.
You have to read the label on the container your caulk remover comes in to determine what ingredients it contains, and whether you need to wear protective eyewear, gloves, and a respirator mask while using the remover.