To thicken chicken and dumplings soup (or any soup for that matter), add about 2 to 3 tablespoons of flour to a mixing bowl. Stir in enough cold water to form a thin paste with no lumps when whisked together. Stir in the mixture to the soup to thicken it up slightly.