Whether or not you choose to cut flowers off your potatoes is up to you. While flowers won’t harm your plants, removing them can channel your potatoes’ energy toward their tubers and encourage them to produce more potatoes. Additionally, potato flowers will mature into toxic fruit that should be removed from the plant if you have small children or curious pets around.