Wasps are not active during the night. After all the wasps have returned to the nest during the evening, the nest can then be removed.