Perlite is non-toxic and safe to use around pets and children. However, it is advisable to avoid inhaling the dust particles during handling, as it may cause irritation to the respiratory system.