To avoid lumpy gravy, mix the flour with a small amount of cold water to create a smooth paste before adding it to the hot liquid. Gradually whisk in the paste, ensuring it's well incorporated and no lumps form.