Remove factors that are found to be not useful