One big difference between both types of gravy is the liquid used to make it. White gravy is made with milk, while brown gravy is made with meat drippings and broth.