Fruit on a banana tree drowning in water will wither and die if not watered regularly. You may have to remove the leaves if the cold or strong winds kill them. To maintain the health of a banana tree, damaged, diseased, yellow, or dead leaves must remove.