Yes, if not properly maintained and controlled, wisteria vines can grow extremely large and heavy, potentially causing damage to structures. Regular pruning and monitoring of its growth is essential to prevent any damage.