Yes, it is ideal that you remove fans during the flowering phase. It ensures faster growth and lesser damage.