It's a good idea to avoid potentially irritating ingredients like intense preservatives, parabens, formaldehyde, and added color or fragrances.
Some companies will advertise that their sunblock doesn't contain these ingredients. But it's always good to double-check the label on products that say they're good for sensitive skin, and don't call out certain ingredients their formula excludes.