Yes, blueberry bushes do produce flowers, but they are not for enjoyment. To ensure that your container bushes do well, you will want to remove the blooms for the first two years the bush is in the pot. That will allow the plant to grow and fruit vigorously. You do not need to remove the flowers from the plant in the third year, however, but they are not showy.