Whisk, whisk, and then whisk some more. Lumpy gravy is typically the result of not whisking enough or consistently. The second reason gravy might be lumpy is adding the milk to the flour too quickly, so slowly add the milk to the roux as you whisk.