Calculate the fill-in rate of the banded matrix