If your gravy has a strong flour taste, it is probably too thick, and the flour never combined smoothly. To fix the issue, turn up the heat on the gravy mixture and let it simmer for a few minutes and add more milk or water into the pot. This will let the mixture reduce and remove the flour flavor.