A mixture of flour, butter, and milk will thicken up broccoli cheddar soup. Melt the butter, add the flour, and stir. Pour in the warmed milk and stir until smooth. Pour this mixture into the soup and stir until well combined.