If you feel that there are bud sites that are not getting light, some light defoliation should be fine, as long as your plant is healthy to start with. Removing anything from a plant can be stressful to it, therefore it's important that all other aspects of the plant are ok before potentially stressing it with defoliation. Removing some fan leaves little by little should be fine.